I was once visiting at a quant fund where they purchased an office building to get physically closer to a stock exchange. It was very expensive real estate and they were a massive fund. They had a lot talented people. Hard to compete with that.
I also read in the Economist a while ago (not sure if its really true, but its believable) that hedge funds are the largest consumers of computer processors in the US. But again, this is something I know very little about. I could be wrong.
The way to think of a big part of HFT is really just automating the old function of market-making, adjusting the bid-ask on many securities to keep things in line.
In the old days if you wanted to trade, you called a broker who took it off for a price, the bid-ask, and you tried not go get ripped off too much. Now institutions who want to trade look for ways to feed them into the maw of HFT without getting ripped off too much, and HFTs try to figure out how to get as much of a bid-ask as possible.
Surely the biggest consumers of processing power are the data centers of Google, Amazon etc... Places like Goldman have sizable clouds but I don't think they compete yet.
"was going to say petabytes but my knowledge is not that granular" <-- entire market data is sub-100GB per day.
" have sizable clouds but I don't think they compete yet." <-- cloud computing is not used in HFT
If you are really interested, it would make sense to start now before rule 15c3-5 kicks in
iirc iqfeed gives you a normalized data format.