If a person had the knowledge/skills to get a spammy SEO site to rank high in Google, they would likely have the knowledge/skills to manipulate a community curated whitelist/blacklist.
You could have a group of humans vote on whether sites can be included in the whitelist and a main criteria is that sites nexus to an actual human involvement. Could that work?