2,349 karma · joined May 9, 2019
Adding more sensors slows his team now more than it improves system performance
I'll take his word on this. It is a lot of work to incorporate multiple sensors.
All necessary information is already in the pixel-space.
I hate to disagree with someone as distinguished as Karpathy, but this is simply not what I have observed from all of that data that we have access to. Given my knowledge of the various stacks deployed today, I would never ever ever get into a vehicle using a vision only stack and expect it to perform in some of the challenging environments encountered during testing.
Not only did DWA have bloopers, there are entire sequences rendered and ready to go that didn't make it in the final movie. There is also some shorts and an entire film that made it to pre-viz that never were released.
In general, I found the talent to be really fun to be around and no-one just phoned it in. They really liked to work on the films. I ended up sitting next to Gerard Butler at the employee screening of Dragon at the now non-existent Universal Amphitheater. He stayed for the whole film. Unlike me, he hadn't seen it in thousands of tiny chunks during dailies, and had a blast.
Steve returned to Apple as VP of CoreOS or something like that. I was super happy when he came back. I think he is living in the rain forests of Hawaii now, clad only in palm leaves.
I know some people from ATG found places to stay if they really, really wanted to, but unless you could directly related your work to something on Steve's agenda, you were gone. Kim stayed and worked on voice recognition, Larry Yaeger stayed and worked on InkWell, Jerome stayed and worked on latent semantics analysis for email spam detection, etc.
Larry was working a lot on what would become Stagecast.[2]
There was so much going on, but the way Steve saw it, nothing was shipping. I think he made the right choice shutting it all down. As I said above, it wasn't at all clear that Apple would end up turing into the Apple we have today.
[1] https://en.wikipedia.org/wiki/Dylan_(programming_language)
I initially joined as a refugee from Be, as it became obvious the PowerPC would no longer be a viable platform for BeOS. I joing the Final Cut Pro team, which has just joined Apple as part of an aquisition of the "Key Grip" video editor from Macromedia.
The FCP team located in IL1 on the third floor I believe. Most of the floor was occupied by the Apple Advance Technology Group. ATG had a really cool space with private offices ringing the outside walls and interior areas with lots of whiteboards and space for doing whatever ATG did. Larry Tesler had a double wide private office and there was a lot of commotion.
The "Blue" team working in MacOs 9 was below us. It was very busy down there as OS 9 was the engine that still powered the company. Those first cool iMacs and MacBooks weren't running OSX! I don't think we even had a "Beaker" build yet.
Steve simply didn't like ATG and over the next few months the spaces rapidly cleared out. We were once stuck in a corner and soon we had a lot of room to set up a couple of large commercial quality edit suite with Avid Media Composers and other high end gear to help make FCP a commercial success.
I wasn't part of any sort of political competition; we just kept making FCP, but watching the exodus of ATG people and seeing how stressed out Steve Glass was running the Blue team was getting me down.
The NeXT people were setting up their world in IL2, with Avie taking an office on the 4th floor and an unofficial sort of NeXT hardware museum springing up outside of the area where the pool table was. It was a cool place to visit; lots of neat NeXT hardware and some SparcStations as well. A Symbolics workstation also showed up in a conference room on the second floor, although it may have been at Apple earlier. If you looked in various hardware labs, there was always intersting hardware to be found; DEC, Infographics, VAX and more.
It wasn't at all obvious to me that Apple was going to figure things out; Steve was being disruptive (in a good way?), but Gil, Ellen, Steve Glass and others were still around and all the NeXT people were doing their thing. I was convinced by some former Be people to go join Andy Herzfeld, Susan Kare, Mike Boich and some other Apple engineering heroes of mine (Darin Adler, John Sullivan) at Eazel.
Eazel folded within eighteen months and I was back at Apple as part of a group hire Andy helped setup with Steve. Anyone who wanted to work at Apple just showed up the next Monday and got to work! Many of those who didn't come to Apple ended up going to Danger Research, Google and other startups. A lot eventually ended up at Apple anyway.
The Apple I came back to was different in that Steve was officialy CEO, but the divisions between groups were still there. It would take several more years before I felt that things felt healthy. As soon as I did think things felt good, Steve become ill, Scott Forstall erected a secure fortress on my floor on IL2 and the political shenanigans began. My initial stock grant priced at $14 a share had grown, gone through a couple of splits and the company was doing billions of dollars a quarter. A far cry from the bleak days of 1997!
I am a former Apple employee but this has given me no special privileges or advantages at all. Perhaps it has given me some particular skill at diving into header files to figure out a solution to a technical problem.
The issue(s) I need the most help with revolve around generating revenues that don't involve advertising, subscriptions, dark patterns or racing to the bottom on pricing. The AppStore model makes it very difficult to use some of the techniques that worked in the old days of shrink wrap and direct online distribution; trial periods, version upgrades and other concepts that don't fit into the AppStore buy it once and get upgraded for life.
It was my decision to make an application that incurred expensive development costs and it was also a risk to depend upon Apple and the AppStore. They sure do make it hard for small developers to try and make a living selling "professional" level applications.
The semantic web hasn't been adopted, so one challenge would be how to categorize and expose the content to any sort of API. Perhaps such a system already exists.
The emacs ecosystem is a good example, but as you stated, it really requires expertise to utilize. I know of commercial service like IFTTT [1] but the thought of having this type of service be a utility available to any browser user is more interesting to me.
I frequently catch myself writing code more from the "I am able do this" rather than the "should I do this" point of view. In my experience, not having a clear goal that benefits a user makes it hard to get any idea adopted.
What do you think an empowered user would want to do? All the pieces are probably there to make things work.
There are several live document editing solutions out there and a recent interesting one comes from Gilad Bracha's Newspeak [1] project. His latest live Document [2] demo is quite interesting as you can edit a live document with the web page. You can also execute Newspeak code and use the results to modify the document as well. His ideas are worth a look if this is sort of thing you find interesting.
[1] https://newspeaklanguage.org
[2] https://blog.bracha.org/WYWIWYG/out/WYWIWYG.html?snapshot=WY...
Both my wife and I ended up working for Be and moving down to Silicon Valley. I would drive by the Claris wedge building on my way to run on the San Tomas Aquino trail and think about what could have been if things had worked out a bit differently.
I eventually ended up at Apple along with some of the Gobe team and a lot of people from Be. Good times!
One interesting fact about the entire presentation of all the new features is that all of the backup Macs but one had crashed by the end. If you watch closely you can see the mirrored demo machines switching in when the live demo box locks up. Whee!