693 karma · joined October 31, 2012
I made a free e-book here (https://emilwallner.gumroad.com/l/no-ml-degree), and I believe most of the key points are still valid, however, when I learned software engineering and ML, ML was a rather small field and tools like chatGPT and claude didn’t exist.
Imo, asking about a curriculum is the wrong framing, for me, it was more about how to find resources to focus full-time and being in an environment that increases my motivation.
I started learning software engineering at home taking courses, but I procrastinated too much to be effective, maybe I did around 10 hours of effective learning per week. For me, studying C at 42 (https://www.42network.org/42-schools/), a free peer-to-peer school was crucial, and I recommend something similar. It enabled me to focus 70-90 hours a week, and after 6 months I was good enough to get competitive startup job offers.
During my time, the FastAI course (https://www.fast.ai/) was the best practical AI course. I'd probably spend a week looking for ambitious projects made by recent autodidacts, and ask them which course they think is best now. And spend max 1-2 months taking the course.
As for picking projects and building a portfolio, the advice in my e-book is still valid. An ambitious but realistic timeframe for landing a FAANG job is 3-5 years. Once you have a solid portfolio, I’d recommend joining say a YC-startup or similar with ex-FAANG employees to get up to speed and references. My first gig was at the YC-startup FloydHub with ex-FAANG employees.
If you are self-taught it’s often easier to get on the FAANG radar by making highly domain specific portfolio projects that are core to their business, or making open-source contributions to their projects. The other route is applying for jobs, however, most people without an ivy-level degree don’t pass the screening stage. If you choose this path, plan for at least 6 month to learn the first part of Ian Goodfellow’s book (https://www.deeplearningbook.org/) using say ChatGPT as your tutor, also grasp the key content in Chip Huyen’s books (https://huyenchip.com/), learn cracking the coding interview, and get good at solving leetcode hard problems.
I end-up doing part-time work for Google at the interaction of Art/Culture and ML doing project like this (https://artsandculture.google.com/story/the-klimt-color-enig...), I saved up enough to build an ML rig (https://www.emilwallner.com/p/ml-rig), since I worked 2-3 days a week, I could spend the rest of my time doing research. I spent 1-2 years working on reasoning, trying different adaptive compute mechanisms and RL on code and mathematics (similar to R1/o1), however, I realised it was hard to compete with the established labs, and if I published my work it was hard to monetize it to have enough time to stop doing consulting work and fund my compute needs.
Instead, I started researching AI colorization, and launched it as a side-project (https://www.reddit.com/r/InternetIsBeautiful/comments/xe6avh...), I ended up having a few hundred thousand users in a few weeks and realized it had enough legs to bootstrap into a company. So I left my consulting gig at Google to go full-time on the colorization project (Palette: https://palette.fm/).
Fast forward to today, Palette is still running with a healthy margin, I’ve outsourced most of the things and I can spend most of my time doing AI research. I’d love to publish and open-source more, but since it becomes too easy to copy, it makes it hard to fund myself and my compute needs.
Happy to answer any questions.
So the most logical way was to bootstrap an AI start-up in the area I'm interested, so that's what I'm doing. Unfortunately, it's hard to publish or contribute to open-source, since it becomes too easy to copy, which cuts my margins and ability to fund my research and compute.
Now I spend most of my days doing AI research, and outsource most other parts, really enjoying it :)
Although, I'd recommend colorizing a few key frames and then use https://github.com/zhangmozhe/Deep-Exemplar-based-Video-Colo...
Cool, yeah, my next model will be better for comic books. You can also use the 'Surprise Me' button in the editor and you'll get some decent results.
Launch Tweet: https://twitter.com/EmilWallner/status/1528961488206979072
Amazon: https://www.amazon.com/dp/B0B1XFF1F8
Gumroad: https://emilwallner.gumroad.com/l/no-ml-degree
I’d love to hear your feedback and if it reflects your own experience with ML.
Here's more information:
- 3D Gallery: https://artsandculture.google.com/pocketgallery/kAUxTZBD8McZ...
- Video overview: https://www.youtube.com/watch?v=1xYpIM_BVTI
- This work will be part of an exhibition at the Museum of Rome starting from 27th Oct, where you can also see Klimt's 'Portrait of a Lady' that was missing for almost 23 years
- More Klimt artworks and articles: https://artsandculture.google.com/project/klimt-vs-klimt
I made a 4000-word guide for people looking to build Nvidia Ampere prosumer workstations and servers, including:
- Different budget tiers
- Where to place them, home, office, data center, etc.
- Constraints with consumer GPUs
- Reasons to buy prosumer and enterprise GPUs
- Building a workstation and a server
- Key components in a rig and what to pick
- Lists of retailers and build lists
Let me know if you have any questions!
If something is missing on the site, just comment with a link to the project.
Also, I'm happy to receive feedback on the showcase.