Sadly I think it's fine. Where I live in the PNW there are way to many people mushroom foraging who seem to have little to no idea how to be in the woods. People rake the forest floor, people leave trash, people leave toilet paper, etc. I've actually stopped mushroom foraging in most places because the forest completely over foraged.
In my experience with most outdoor activities the concept of leave no trace is completely lost on people, so unfortunately I'm fine with less people mushroom foraging.