John Carmack visits Starbase
twitter.com
twitter.com
> I did kind of volunteer to help them fix what I consider very poor user interface performance on the older model S (that I drive). Their engineers have been sharing data with me.
That sounds like kinda sorta starting to join...
Working with Tesla on AI actually sounds more like what he's been working on recently... at least if he can convince them to give him a lot of flexibility on what exactly he works on.
It's the equivalent of Michael Jordan spending the remainder of his athletic career trying to play baseball. Sure, he could have done that. If the White Sox had allowed him on the team (ignoring the strike for a moment), more than likely all he would have been doing is taking the job of someone better at playing professional baseball than him; while his greatest ability by far rests in his basketball prowess.
Carmack already did a deep run at aerospace. He has N time left. Where can he combo make the greatest impact and enjoy the work. I'd guess that's something close to the equation, it seems to be for most people in that position/stage of life. Working at SpaceX is unlikely to be that place all things considered. What might have happened if Carmack had joined in the early days instead of doing Armadillo is an interesting thought (it's hard to see how the SpaceX outcome could be much better than it has been though, realistically).
According to the book 'Liftoff' about the genesis of SpaceX. This does not accurately reflect how they hire. Domain knowledge and skill is part of the equation, especially for the leadership team. But they'll also pick up anyone with a proven ability of solving difficult engineering problems even from completely different disciplines.
SpaceX is doing things that haven't been done before anywhere, thus the domain experience can only take you so far...
Sure, but that could just as easily describe Carmack's current efforts in AGI (and I seem to recall that he even tweeted something to that effect himself, though I can't find it now). Him achieving AGI as a solo researcher seems less likely than him making some big technical contributions to SpaceX, or Tesla AI.
Edit: I think I was recalling this tweet: https://twitter.com/ID_AA_Carmack/status/1411010796285480965
The impact of AGI is far greater than rockets, too.
Carmack is working on artificial general intelligence. As far as I know, that's well outside of anything Elon is doing.
https://youtu.be/j0z4FweCy4M?t=7775
Whether Tesla wants to fund serious work towards that may be a different question (but they do seem to be serious about at least building the robot).
If you haven't watched the Tesla AI presentation, I highly recommend it. The dancer in a spandex robot suit is getting all the headlines but the technical presentations are the real deal. Karpathy in particular is an excellent technical presenter and he didn't hold back.
It's not AGI. An AGI is something that can think for itself, the way you can.
Why do you think this?
Though Carmack probably doesn't agree with me on this given his statements that "I believe that current supercomputers are actually sufficient for human level AGI" https://twitter.com/ID_AA_Carmack/status/1340369768138862592 and "I am provisionally not very interested in custom AI accelerators, because I don't think the extra performance will outweigh the reduced flexibility and immature software compared to GPUs" https://twitter.com/ID_AA_Carmack/status/1412897975370719235
More teraflops are not what is needed.
Also, I think most people who have so serious deep learning believe that larger models/faster iteration will only get us so far.
OpenAI seems to believe that scaling transformers can solve many if not most problems, so I'm not alone here.
- Long iteration time kills productivity, a lot of AI work has long iteration time because hardware is slow.
- It's possible that bigger models on faster hardware are actually all we need to solve some problems. For example see GPT-3.
Making custom AI chips (other than as practice) seems a giant waste of money at the scale of it. In addition I was kinda underwhelmed how little benefit they got compared to an off the shelf solution.
Edit: Someone else asked the same thing before.
https://twitter.com/ID_AA_Carmack/status/1423053681520414724 > A troll was trying to get a rise out of me yesterday, suggesting that I should somehow feel bad about Elon's success after my failed aerospace venture. I can't overstate how alien that thought is to me -- my joy at these things being built is deep.
https://twitter.com/elonmusk/status/1423162437034037248 > It would be an honor to have you visit Starbase
That's an amazing way to respond to a troll.
Musk and Carmack are both rocket nuts. Carmack ran a rocket company: Armadillo Aerospace, mostly as a hobby. From engineer to engineer, Carmack has a lot of respect for Musk, and Musk tried to offer Carmack a job at SpaceX, as in "stop playing with your toys, we have serious rockets here".
But they are also pretty good at roleplaying engineers. I suggest watching the latest Tim Dodd videos when he tours Starbase with Elon Musk and you'll see Musk engineer character. No nonsense here, no Mars colonies or hyperloops, just the practical considerations of rocket building.
As for John Carmack, my preferred example is that short discussion with Elon Musk on Twitter. https://twitter.com/ID_AA_Carmack/status/536277962803650562
I still think the whole passenger part of spacex might be a pipe dream but who knows.
Elon Musk speaks quite aspirationally and optimistically from time to time, for both Tesla and SpaceX.
> SpaceX has delivered
They sure have! Tesla has also delivered over 1.7 million cars. They're on track to deliver about 750k cars in 2021 alone.
It was very up Musk's "first principles" alley, but wildly underestimated the capital needed to be successful.
At least, I think that's how the history went. I could be wrong.
People tend to seem to start from #1
But seriously, is there a better title to give him for that part of his work?
Edit: Pioneering achievements, yes, certainly, but pioneer as in "game development pioneer"…
Omnissiah or Machine Spirit.
[0] https://venturebeat.com/2016/10/07/oculus-john-carmack-argue...
In any case, it's funny he's still using the I'd handle on twitter. Whatever happened to that lawsuit
Finally somewhat on topic: I really thought they had a chance when armadillo won that NASA moonlander prize.
Northrop Grumman Lunar Lander Challenge.
I'd really wish John would put fingers to the keyboard and write the history of Armadillo Aerospace. From buying a peroxide engine from Juan Lozano (?) to decision not to continue, even with that grand CNC behemoth as a birthday gift.
Still wildly successful, but man that platform is an amplifier.
Increasingly distant as labor costs continue to soar in China that their demographic crisis will only exacerbate. China speed now is only possible due to a never ending debt stream that gets eternally refinanced.
https://en.wikipedia.org/wiki/996_working_hour_system
With a society that had been dealing with famine, poverty, and labor opportunities consisting of subsistence farming in living memory, working 72 hours a week to receive a steady paycheck and a full belly seems like a pretty decent trade.
When you look at the history of the Industrial Revolution and the Western labor movement, I have to have doubts that this "speed and agility" will last. People who are prosperous start to have higher standards, especially as new generations enter the labor market. There is already significant pushback against the 996 system.
It's not hard to out-produce when the average person is working almost double the Western standard.
I thought the documentary "American Factory" was an interesting window into the lives of Chinese and American factory workers. My own analysis/opinion: the factory workers in China were indeed shown to be working quickly, obediently, and working long hours. The Americans looked lazy at times.
I thought the reasoning for this difference was that American workers used to union protections already had generations of knowledge about why they should not become wage slaves risking their health and safety for their capitalist employers, despite having few other options in a town where most of the factory jobs left.
I personally wonder when the typical Chinese worker will wake up to that same reality: that speed, agility, and fast innovation aren't really worth selling your weekends and joints and tendons away just so that the boss can buy a third vacation home.
[0] https://www.city-journal.org/high-costs-construction-delays-...