The type of shop you're describing might be able to compete, assuming you've identified a niche product with a margin that will still exist in 6 months. Backtesting is useful, but it is so bloody hard to accurately incorporate liquidity that I place little value on simulated results when it comes to short duration trades. You really have to jump in and test live, which represents the largest barrier to entry: established shops have the infrastructure & capital to try new ideas. When I was trading, we tested half a dozen new ideas every month in addition to "production trades".
High frequency, IMO, should really be used to identify hardware intensive strategies co-located at the exchanges and utilizing telecommunications strategies not readily available to the market. For example, FPGA and dedicated microwave towers.
Lime is excellent, btw, but you really need some volume to justify them. For options at your level of capital, Interactive Brokers and long gamma trades look more attractive to me. Many would disagree and people do starve waiting for long gamma, but my memory is biased after seeing the little group next to me lose $40m in a week on a stupid short gamma "sure thing" based on back tests and other such nonsense. Oh, what a fun time that was.