I rarely see plastic tea bags here in the US (outside of Starbucks). Most use filter paper.
I believe most have transitioned away now... or, at least, the only brand that matters if you're British has transitioned[0]
[0] https://www.yorkshiretea.co.uk/brew-news/plastic-in-tea-bags...