I don't have to because I just use the "following" tab? I only see people I follow. Really don't get the point of this service
but i feel you, the following tab is definitely a healthier/more controllable space
I still do it that way, better to do a (very) slow roll and build up a network slowly than to follow the accounts Twitter's algorithm thinks I should follow (IMHO).