Hacker News Reader

Comment by modeless | Hacker News Reader

I think it's less of a judgement about VR and more of a judgement about AI. If you believe AGI is within reach (as he does and I agree), working on literally anything else seems like a waste of time. It's impossible to overstate the impact it will have.

View on HN

Wouldn't be surprised if SD, GPT-3, and other recent releases were what pushed him over the edge and prompted him to leave. He must have felt like he was watching a lot of cool things happen without him.

If I had another 30 IQ points I'd be climbing over walls and sneaking into buildings at night to work on this stuff.

I believe he talked about starting work on AGI at the time he went part-time at Meta, long before GPT-3.

I encourage anyone to try out some AI related stuff, genius IQ not required. It's still a young field so there aren't yet huge towers of knowledge to climb before you can do anything. The core ideas are actually super simple, requiring nothing more than high school math.

It's the mainframe era for AI: ideas are simple, but access to mainframes isn't.

The hardware is fairly accessible. You can start for free with Colab, try a subscription for $9.99/mo, or use the gaming PC you might already have. The hardest thing is data, but again there are lots of free datasets available as well as pretrained models you can fine-tune on a custom smaller dataset that you make yourself.

Any specifics for trying out AI stuff? Take some online courses? Play around with some simple models in DL frameworks?

Andrew Ng's online courses are great to get your feet wet. You use Octave/Matlab to implement the basics of many machine learning models from scratch, and build yourself up to using python to design several popular deep learning models including convolutional and transformers. It's not required, but a good idea to understand at least the basics of linear algebra and calculus.

I think the course just got updated during the past year and now they use Python instead of Octave/Matlab

Interesting. To be honest I really appreciated how they started with Matlab; it gave a very math-centric focus to the fundamentals, although of course you can do all of that with Python too. And I say this as a professional developer.

FastAI gets recommended a lot I think, if you can already code - focuses on hacking with frameworks instead of starting with the boring linear algebra stuff.

https://course.fast.ai/

It's good to have a $50k mini-supercomputer at home though, so you can actually try out your ideas in a reasonable time.

Reply on news.ycombinator.com