This depends on what are you training the model for. Arguably wikipedia is a much better dataset for all things related to real world and history than Fb’s feed or activities or a bunch of websites optimized for SEO.
This is easily illustrated by ChatGPT not being Google or Meta and doing a pretty great job with available sources.
So no, this doesn’t matter much, imo.