It is a self-balancing situation. A scenario of "oh my god, everyone is just putting their money on index funds" would never happen.
Another way to think about it is in terms of evolutionary stable strategy. Index funds and arbitrage-seeking reach a Nash equilibrium at some point (far more index-allocated than today's market) where arbitrage-seekers will reap returns almost equal to index funds, as index allocation starts o not capture all available market information.
If the market deviates from that point, forces push it back into that point. If the market starts over-allocating into arbitrage-seeking (like today), returns on index funds will beat arbitrage, pushing capital back into index funds. If the market over-allocates in index funds, index funds will return below arbitrage, pushing money out of index funds.
Edit: Right now, the market is still far over-allocated into the arbitrage-seeking side, resulting in a natural shift to index funds.