The limiting factor is leverage. If a hedge fund (or equivalent) had enough data and confidence in a company, they would borrow money to increase their position size. This would make it possibly to affect price for non passive investors.