None of those actually have an /about page, yet your site says they do...
Another funny thing: just search 404 or not found and you'll get a lot of 404 pages
Do you have an idea of how to remove company websites in an automated way? I didn't want to manually review all 7k indexed websites.
This is the GPT prompt I used for filtering domains to add, but it gives false positives:
You are an API. Return a JSON array of booleans indicating whether each provided domain is someone's personal website. Use common sense. Make sure to return false for company websites.Most are a 4xx code, I checked myself, some may be 301/302 redirect to 4xx not being handled properly by their crawler
Right now it only excludes pages based on the text content: https://github.com/lindylearn/aboutideasnow/blob/main/apps/a...