Hacker News Reader

Comment by motoboi | Hacker News Reader

You forgot YouTube. The source of world model data. THAT is the mother of all moats, if they can survive until capable of taping into it.

View on HN

well its not moat tho since every AI company can just simply access the video youtube has

Before 2025 yes. Currently not. YouTube implemented severe restrictions to scraping and downloading of videos. You can get away with maybe 5 videos, after that you enter a tar pit.

If you continue, you need to log in.

If you continue, the account is blocked in less than 30 minutes.

If you try to use cloud machines you are blocked before the first video. If you try to use known proxies, there are already tar pitted or blocked because everyone is trying.

lmao

You are dead wrong if You can stop Industrial scrape

Just make it too expensive. Wanna buy one internet link per hour to download videos. Or maybe rotate between source IPs (google will block the whole ASN ip block in less than an hour). Or maybe pay people to download videos for you? They can download maybe 20 in a day, for a week, because tarpit and blocks.

It's a numbers game.

it literally doesn't cost that much different and I guarantee you that is not gonna work

I call it phone farm and this is individual/small group run

imagine they got access to more money

https://finance.yahoo.com/news/click-farms-internet-china-15...

I downloaded about a thousand videos (300gb) from YouTube this past week without logging in.

I used two IP addresses in a datacenter. Both were blocked after a few hundred videos, but the block expired after a day or so. It is not as hard as you make it sound.

Reply on news.ycombinator.com