Plus the big problem of sources curation, those are more unreliable in unpopular articles for the lack of eyeballs on them. The amount of work mods have to do would grow exponentially if they didn't take notability into account.
Maybe you didn't intend this but it sounds like you are saying that Popularity == Notability. I don't think that's a helpful stance to take. Especially since as time progresses, older things will generally become less popular and thus trend towards deletion if what you say is true.