390 karma · joined July 7, 2010
"A single run of the DGM on SWE-bench...takes about 2 weeks and incurs significant API costs." ($22,000)
The "deep learning alone is enough" camp (especially LeCun) has abused him for years but now slowly coming to the realization that we need to feed neural networks with explicit inductive biases to attain AGI which is exactly what Marcus has been saying since the 90s. LeCun, for some reason, refuses to call these explicit biases as symbols and that's the only disagreement between Marcus and LeCun these days.
The argument that users can now generate professional grade art by bypassing artists entirely feels so strange. I have access to Dall-E. To generate images without artifacts, you have to do one of these: a) Do a lot of cherry-picking which can be expensive. b) Prompt should be about an abstract concept which can "tolerate" any number of artifacts. c) Prompt should be about a common/generic concept that you have already seen a lot of times on the internet.
I think the biggest use case of Dall-E will be in removing creative block for artists.
There are already full blown online DAWs like BandLab, Soundation, Amped Studio etc.
Professor Xavier Serra[1] is a highly respected veteran in the field.
Just listen to this from 30s: https://soundcloud.com/openai_audio/pop-rock-in-the-6355437/...
Such coherent and pleasing melodic phrases in the style of Avril Lavigne. I thought it could be copying wholesale from a song unknown to me. Nope. Shazam doesn't get it.
This can revolutionize song writing/composition/production and soon music listening/consumption.