271 karma · joined January 20, 2020
It's like that classic sedentary worker ailment of the sore back. Many people take this as a sign to rest more, but these types of issues are often caused by weak musculature and the best thing to do is start resistance training. Obviously not a blanket solution, but one that definitely seems overlooked.
And then just feed it endless continuous video of the world from a persons perspective (ie, not just random jumps around scenes) How is that any different to the way humans developed our own theories and understanding on the universe we found ourselves in? Obviously a video feed isn't quite the same as having a myriad of senses like we have for interfacing with the world. But theres no reason to say newtons laws need touch or smell to be figured out (maybe that is a bad example for not requiring touch, being about mass and force, but you get the point). Learning language and understanding of the world from scratch might depend on having physcial interaction with the world, sure, but thats again just different sets of input training data that a multimodal model can make connections between if there were pressure to do so.
Then you simply prompt the LLM to define the laws it has observed in a way that can use language to transmit the idea. In the human equivalent, a "prompt" doesn't need to be (but can be) a direct question being asked. It could just be our urge to share ideas, an emotion perhaps that moves us to action. I don't want to go too far on this thought as it is pure speculation without serious scientific backing, but for the sake of the thought experiment with all this in mind you could even say that brains are much like an LLM that is in a constant state of training & updating, but also being "prompted" from our environment and biological feedback loops being fed in. I don't feel like this idea is even that controversial or remotely original.
The difference is that models of today are already trained on the corpus of human knowledge so they already know all of this instead of having to figure it out. But I don't really see an argument for why an LLM wouldn't be able to crystallise observed patterns into mathematical formulae if it had the appropriate influences that would encourage it to do so. Its just that we don't care to train them inefficiently. I imagine this will be tried in the near future though.
Good exercise in not blindly accepting things, which is arguably more valuable than a cute Netflix homage
> "Researchers recently discovered that the proton sometimes includes a charm quark and charm antiquark, colossal particles that are each heavier than the proton itself."
You articulated my feeling better than I could. Surely this is something the researchers have accounted for and there's a good explanation (whether I can actually understand it is another story)
My group (3 of us) bought a moisture sensor to plug into the pi, and had the idea to make a "flood detection system" that would be housed under a bridge, and would send an email to relevant people when the bridge home from work is about to flood.
So for our demonstration, we had a guy in the back of the class with gmail open ready to send an email saying some variation of "flood warning". Our script was literally just printing lines with wait statements in between. Running the script, it prints to the screen "awaiting moisture", and after 3 seconds it will print "moisture detected". In that 3 seconds I dip the sensor into the glass of water. Then the script would wait a few more seconds before printing "sending email to xxx@yyy.com". We then opened up our email, our mate at the back of the room hit send, and an email appeared saying flood warning, and we would get full marks.
We also have very unusual tax laws around owning a rental called negative gearing- if you're a landlord and your rental property earns less than it costs to run it, you can subtract the difference from your taxable income and pay less tax, as if having a tenant pay off most of your mortgage wasn't enough of a free lunch.
A political contest vowing to get rid of this nonsense was annihilated when we tried it one election cycle around a decade ago.
I mean... I guess the climate did change, but it didn't seem like that had anything to do with anthropomorphic climate change, which is surely the implied idea of the category