In theory I follow few enough people to be able to sit down and read every tweet - I rarely want to. The magical "algorithm" seems to do a reasonable job of raising tweets with high activity, or tweets from people I often interact with, to the top.
This seems entirely reasonable to me, and if I want to see the rest, I can just keep scrolling.
Perhaps it is more of a problem if you follow hundreds of people. But I don't do that, and if I did, I'd never be able to read everything anyway.