I’ve been running pihole with my own resolver for >5 years and don’t have this issue. I run into it much more frequently when behind CGNAT.