Sometimes it introduces you to new people though that are interesting to follow (usually because people in your network liked their post or something). I find this generally valuable.
If you want to be extreme about it, you can put everyone in lists and then this won't happen. You can also use a third party client that doesn't do this.
My main Twitter complaint is the ads. There are so many and they suck. I'd much rather have Twitter premium that removes the ads.