Hacker News Reader

Comment by jasode | Hacker News Reader

In the previous [flagged] submission, the author provided some comments about this project: https://news.ycombinator.com/item?id=40569686

In any case, the title is "large media brands" so urls like "nytimes.com" and "washingtonpost.com" are consistent with that theme but the "blocked_domains.txt" also has "apple.com" and "microsoft.com" which are not media publications. If the motivation was avoiding SEO spam when searching for reviews of "air purifiers", domains from non-media-publishers like Apple.com and Microsoft.com are not part of that problem.

If instead the author is really trying to block "any big companies" rather than just "big media", it seems other giant non-media companies like NVIDIA, Toyota, JPMorgan, etc would also be on there.

View on HN

Hello. Why it worked this way is because I can't find a list of 588 websites by thoae 16 companies (I've contacted the people in those articles to see if they have a list), I decided to find a list of top 1000 popular sites (which is much easier to find) and then try to clean those up. Obviously that's not a perfect method and leaves a lot of sites flagged by mistakes, but I didn't find any other way. I left it open source since I want people's help if they find mistakes in the list or want to supply their own list. There's nothing special about the code, I pretty much asked LLM to write it the whole way. I didn't set out to make money from this project, I just want more people to see what searches have become: a bunch of people with a lot of money pretty much own 90% of all searches.

https://detailed.com/wp-content/uploads/fandom-change.jpg

Can't you simply go through this image and manually create a list from all the logos?

Yes, it would take time and would be tedious, but it's very possible to do in an afternoon.

> I decided to find a list of top 1000 popular sites (which is much easier to find) and then try to clean those up. Obviously that's not a perfect method and leaves a lot of sites flagged by mistakes, but I didn't find any other way.

This shows that your primary mistake is not that you’re not a developer, but that you are not willing to devote time and be analytical about the problem you want to solve.

Yeah, as someone who has built similar projects, this is a few hours of research to come up with the list of domains. You really should’ve done that; most of the comments here are negative, and ALL are related to the list you used.

It’s a cool idea and personally I would still do the research, revise the list, and then post it to HN once more. It’ll get a much better reception.

Reply on news.ycombinator.com