Many of the most poisonous berries are sweet. Belladonna is extremely sweet.
Much of what is bitter (basically every non-sweet plant out there) is harmless.
If you judged the safety of food by taste, I’m afraid you wouldn’t last long in the wild.
But is this a pattern because humans, like other species, find a niche where they can consume something that makes other life forms sick?
It's always an advantage to be able to benefit from something others can't, so you're not in direct competition.
It is always advantageous to be an omnivore. The more things a creature can consume, the more it will reproduce and the more ‘niches’ it fills.
Cockroaches, flies, bacteria, and — through the use of intelligence that enables turning virtually anything into nutritional energy - humans.
There is never an ‘advantage’ to limiting ones foods.
I agree in theory, if there were no tradeoffs required to consume any particular thing. But my comment took for granted that there are. Even for really versatile species, there are to some extent.