This isn't really a surprise, given that there's much lower friction in asking an LLM compared to using Stackoverflow.
However it's still kind of a concern. I'd guess that a lot of LLMs used stackoverflow data in their training and if it dries up as a source of data, it will reduce the usefulness of later generation models, unless an alternate set of sources can be created/used.