I think the point is that if it fits on a single drive, you can still get away with a much simpler solution (like a traditional SQL database) than any kind of "big data" stack.
Once the index is too big to have in one place, thing get more complicated.