You may ask, well, why do we need market makers at all? Well, you don't have to use them. You have other options for trading. Call up your broker and ask. What you'll discover is that these other options have far larger transaction costs.
A lot of the complaints about HFT I've seen on Hacker News seem to think that no one should get paid for market making. I don't think that's possible. (And if it is, I'd love to know how.) Transaction costs are an inescapable part of trading; ultimately, you're faced with the choice between tilting your hand to other traders or paying some intermediary to take on risk for you. Generally, it costs less to choose the second option.
You argument is that Vanguard is a market maker, Vanguard likes HFT, thus HFT must be good. That doesn't really follow at all. Vanguard could be arguing in favor of HFT for all kinds of reasons, one of them could be that they have the money to rent server space right next to the main exchanges, and pay for the ludicrously low latency connections to the exchanges, so they benefit from HFT by being able to be quicker than others, and they don't want to loose there edge.
Now a small team of researchers can make markets on many securities at once. They don't have to make as much money on each, so the spreads get smaller. Additionally, instead of a monopolistic specialist, these professional traders compete to win transactions by making better prices (higher bids and lower offers) than others. Many market makers try to keep a neutral "book" of positions, so if they sell some GS they may bid higher in other bank stocks to reduce their exposure to market risk. The faster a market maker can update his quotes or hedge when conditions change, the less spread he needs to charge.
http://meanderful.blogspot.com.au/2013/01/hfts-dirty-little-...
See, again, per the article, Chesterton's Fence.
Not only does nanosecond resolution provide zero benefit, models indicate that it actually harms liquidity. To be specific, serial order processing in continuous-time is more efficient in "time-space", but less efficient in "volume-space". The better mechanism is batch order processing in discrete-time (i.e. process all arriving orders simultaneously in batch every 100 milliseconds, rather than one-by-one every nanosecond): http://faculty.chicagobooth.edu/eric.budish/research/HFT-Fre...
Because the markets are fast, there is less risk that their hedging product will "run away" from them before they can execute. Since the risk is low, they can make a very competitive and tight market. If they had a 100ms delay to hedge, they would need to make a bigger spread to compensate for the risk.
>When they do start doing something stupid, then they will lose money and be punished
hehe no, trades will be reversed, people that "maliciously took advantage of poor algo error" will be punished instead
Another thought on HFT's value to society: I generally agree that HFT does not provide "direct" value. There are clearly "arbitrage" opportunities that HFT firms consistently profit from. However, by definition, those arb opportunities will either be taken by someone else, or enough people will run into grab them such that the arb goes to zero. If there are consistent arb opportunities then something needs to change - namely the regulation which structures the market and allows people to take consistent advantage of it. Thus new regulation is issued and the market, inherently a complex and intricate system, becomes stronger as a result. This is maybe where the value to society lies. and maybe this is an idealistic view of how regulation, society and HFT interact in this case.... ?
Like you said, if enough people do the arbitrage, it converges to zero very quickly. There's little profit in it and everyone reaps the benefits of near-instantaneous accurate pricing.