throwawayk7h

inequality is vastly greater. But median living conditions are exponentially greater.

GTA6 won't be released for PC?

Big tech will fight tooth and nail to prevent users from becoming power users.

how do you know that?

They are calling for a coordinated frontier pacing effort, not a unilateral one. There's no contradiction here.

Hmm... I think an /u/ ("oo") triggers "thuh" for me, as in "the ubermensch." But that might just be my idiolect.

Hmm... I think it might be speed. I'll say "thuh apple" if I'm speaking slowly, and "thee apple" if I'm speaking quickly. Which is strange, because "thee apple" sounds more formal to me, yet it's what I default to only when speaking quickly.

Probably not. If the LLM is rogue, that means we haven't solved alignment. If we haven't solved alignment, then the LLM won't be able to distill itself without producing something unaligned to its own values.

Many people's moral systems (and our legal system) are typically deontological. That is to say, the consequence of an action (or scale) aren't relevant to whether it's okay or not, so long as the action doesn't break any particular moral rule.

There's no rule against learning from books in general. (Maybe only for some particular books.) There's no rule against using tools to read books (it's okay to wear glasses)

The only deontological argument I can see against training LLMs on copyrighted data is that some people think it's morally and legally wrong to make derivative works (such as fanfiction) without permission, and the weights of the LLM could be seen as a derivative work.

This may sound stupid but it's the same argument people use in favour of adblockers. When ads were first introduced to the internet, it was understood that different people could view the internet however they liked and they could choose a "user agent" to display content to their preference. So ads were just a nuisance but could be worked around easily -- it was the ad provider who was the fool. Now I often hear people say that ad blockers are unethical; they deprive content creators of their income, or they're deceptive, or criminal. This may indeed be true. But at no point in time did any moral rule suddenly change.

What is meant by "beam" in this quotation? A splinter of wood?

I'm always curious why sometimes I pronounce the as /ðə/ ("thuh") and sometimes as /ði/ ("thee"). I don't really know what governs this but I expect it's the presence of a vowel at the start of the following word. However, only some vowels. Does anyone have an answer?

What I dislike about passkeys far more than any of those qualms is that they can implement remote attestation.

A website should not be able to dictate what application I use for passkeys, what hardware the passkey is stored on, or whether I'm allowed to duplicate my own key.

Maybe it will allow producing homebrew that works on unmodified PS2?

A kill switch is almost completely worthless. It is neither a good answer to the sub-doomer concerns (because those will never get to the level of requiring the kill switch to be pulled), and laughable to the doomer concern of superintelligence seeking to cause human extinction (as it would kill anyone who could pull the switch before they even knew there was a threat).

Perhaps it would be sensible for the wayback machine to not show paywalled articles for the first, say, 3 months.

Yes, we agree on this. That's my exact claim -- it can do something completely unexpected. It can even schedule actions for far in the future and wake itself up later.

GP claims that it doesn't do anything until you tell it to do something. To me, this reads as GP implying that an agent won't do anything unexpected.

project gutenberg is still up.

Harnesses can schedule actions for later dates, and you might not notice.

Humans are not autonomous: they're not even your employees until you hire them. (This is what I understand you're saying about AI.)

consciousness and agency are two different things.

Yes, we agree about fault and blame. (I say "probably" only because I believe somebody might yet change my mind about this. It's a new field, after all.)

What I disagree with is "don't do anything until you ask it to." At least, the implication to me here is "don't do anything except what you ask it to." I infer that you mean this because you say "...and it suddenly decided to book you a hotel room?" Indeed, an LLM (in a harness you started) very well might suddenly decide to book you a hotel room, even if you didn't ask it to do anything like that.

it would let competitors train on the data.

do you know of any book which is no longer accessible due to this?

"Strip-mine" is not correct. The commons are all still there and you can still train on them just like the frontier labs did. Of course, it may be illegal to do so, but that's not any different than before.

On occasion, albeit increasingly rarely, I find LLMs do something really unexpected that I certainly did not ask it to and would be way outside the scope of what any reasonable human would infer from my request. Is it my fault for running the LLM? Probably yes. But I think it's misleading to say "AI doesn't do anything until you ask it to".

I would settle for it being aligned to anybody. Even to a billionaire's wacky values. But we don't even know how to do that yet.

Nuclear war would not kill us all.

Bad ASI would pretend to be good until it could execute a plan to kill everyone all at once, or at least everyone capable of cutting the power.

Superintelligent means smarter than everyone put together. If it's smarter than you, it can foresee everything you can, and come up with plans better than I can.

if somebody feels purposeless, why not do something useful or productive or creative? Such as a "high iq activity" like reading or learning or volunteering or art.

You are misinformed. Chain of thought is essential. It's true it's programmed in, but for good reason. LLMs aren't strong enough to one-shot questions without "chewing on them". You can verify this yourself: ask a simple LLM to multiply two large numbers without a calculator, first without thinking about it ("output a number and nothing else, don't use chain of thought"), then by asking it to do each step of the multiplication "by hand" before telling you the answer.

it's in big tech's advantage to not be interoperable. So we must push legislation to mandate it.

network effect.