The Internet is full of bots. It is full of corporate bots that scrape data for AI. It is full of government surveillance. It is full of North Korean Lazarus hackers. It is also full of tech enthusiasts that have various projects. It is full of people that use various RSS readers.
I often am repulsed that servers reads user agent. It is often not used for compatibility reasons, but just to detect if you are running official browser, or if you are 'privileged user'. This leads, obviously, that some programs needs to use disguise, which would not happen if servers were friendly toward friendly bots. Imho there is a problem with bad-bots, not all bots, that take away your bandwidth, processing power, etc. etc.