Hacker News Reader

I don't think this is the only factor but I suspect part of it is because GPT-4 had access to better datasets.

After ChatGPT came out a lot of the places GPT was assumed to be trained on (reddit, twitter) started closing their APIs.

This alone represents a pretty significant moat.

View on HN

Reddit was still pretty easy to get last summer. I saved a copy. Twitter has never really been easy. Some data sets are getting locked down, but you can still get them if you have enough motivation. I think the technical skill first and compute access are bigger hurdles.

Reply on news.ycombinator.com