As much as a Google replacement would be great for competition, it would be extremely difficult. Google was able to scale with the web gradually through anti spam and proprietary software, but a new competitor would struggle to reach such a needed scale so quickly
Tl;dr: High cost of entry for newcomers