Plastic tea bags aside, I was shocked to learn that many paper tea bags still use plastic glue [1], which can contaminate compost.
[1] https://www.countryliving.com/uk/create/food-and-drink/news/...
[1] https://www.countryliving.com/uk/create/food-and-drink/news/...
https://www.ethicalconsumer.org/food-drink/there-plastic-my-...
The best advice is drink loose-leaf.
You can also get away with microwaving metal spoons but _not forks_.
However I did note that the plastic tea bags get in the cups in the USA for longer as the water is lower temperature. It appears as if American baristas use coffee brewing temperature for the teas so a customer has to leave the tea bag in for the length of the drink.