For a brief moment I thought this is about the game Rune[1] and got excited as I have played that a lot when growing up. Alas, that wasn’t it.
1,306 karma · joined June 13, 2016
As for the camps, I agree with you that B doesn't really make sense (at least to me). I can put myself in position to argue for A, C and D, but as mentioned in my original post so far I agree with C the most.
To question 1 based on my current understanding (and let's say "beliefs") is that - yes, LLM's are following a probabilistic algorithm to give me the output. The same prompt won't yield the same result, but the same prompt will yield results that are quite adjacent to each other in meaning because of the training. There's randomness in the sense that you can't say which next token will be put with certainty, BUT you can be certain it will be a token that exists in the pool of tokens available. Hopefully that makes sense?
For question 2. Both us and LLMs are constrained by physics. The main difference for me is the fact that at every point of our existence we're constantly changing. Our internal state and bodies are changing based on all the sensory input we get from our environment and the processes that lie underneath. Another commenter in this thread talked about qualia. That's certainly part of it as well (but again we have a definition problem). That's not to say that I think that a hypothetical future machine cannot be devised to handle a lot of these, but the level of sophistication in the biological world is such that I don't think that's realistic. Let's say that even then, that happens, would that really prove that humans work the same way as the machine?
A lot of materialists are in Camp A. For some even today, LLM's are AGI. Unfortunately, the terminology is quite clearly not adequate. There's many a people that have very different ideas and feelings on what's what.
The question on whether you can have "intelligence" without "consciousness" or "self-reference" are just on top of those. How can we define if a machine is "conscious" if we can't agree on what consciousness is? Panpsychists solve that problem by going the other way and saying that everything is conscious.
Overall these are very interesting topics that we can all ponder. The realities at the current time are, however, that LLM's are indeed useful. And the harnessing tooling that is being employed those days solve a lot of actual usage problems. Whether they solve other fundamental issues remains to be seem IMO.
[1]. I realize a lot of people probably haven't read the book, but you can ask your garden variety LLM to give you a quick rundown on the four camps that Sir Roger is using :)
Edit: typos
We can all cherry pick "facts", but history requires context. Your replies are all in bad faith. I'm done with this "discussion". To future readers - beware! This is how actual misinformation and disinformation works.
I really don't understand (French) communists (if you are in fact French, assuming from your bio) such as yourself spouting nonsense. You have all the information and experience of people who have lived under such a regime or in the fallout of one, and yet you keep talking bullshit. You have no idea what it was like to live under such a regime. This left-wing wave that's festering in the Western world should've never been allowed to happen. If people such as yourself actually paid attention to what really happened to every country in the East, all of us in Europe would've been in a much better state nowadays...
On the political aspect Russia has always hated the fact that small Bulgaria gave them their alphabet/culture and has used it's influence to bitch, moan and subjugate ever since. Most recent rage bait is with bullshit like saying that it's actually from (the country now known as) North Macedonia.
LSP as a protocol is fine, but the actual technical implementation of JSON RPC is braindead. Only web devs that don't know anything about native code could devise such an abomination. What happened to plugins and dll's?
Tech stack doesn't matter? IT does matter! The tech stack shapes not only the platform, but the way people think about the problem and the possible solutions given the constraints. Beauty in code does exist, but you don't get anything done when the only thing you do is pontificating on things like that. It's an iterative process.
Honestly dude, check yourself. You're a junior. Any experience will be good for you. Nothing wrong with that, but unless you put in the hours in the grind you'll never be good. To realize that you need true humility, not the stuff you've written about "architecture" and whatever. What have you actually done?
If this is what I get in an interview I will terminate it quickly.