nullsense

I thought those scrapes of the web like The Pile we're only around like 45TB?

It's a good point though. I'm sure logistically it'd also be way harder than the embarrassingly parallel nature of crypto mining.

Saw this a few days ago. Really enjoyed it.

I thought he made a good point about dictatorships being positioned fundamentally differently than democracies with respect to the current technology that's out there now.

I also found his answer to the question someone asked at the end about hackers in their basement pretty interesting. He was like well hackers in their basement can't create these big models yet, so we can still regulate it. That's true in a sense, but I did notice the other day on that mdegans HuggingFace incident that someone offered up their 200x GPU crypto mining cluster to train uncensored models in support of ehartford who was copping a lot of abuse from this mdegans character. So, I wouldn't be so entirely sure that there aren't at least in principle _some_ hackers that can do it.

Neat. Will have to have a play with this on the weekend.

Yeah, I second this. I use this frequently and lots of models downloaded that I test out with it. I'm keen to see a more API led approach.

Any evidence or sources for that? I just don't know how that would be knowable to any of us.

Yuval Noah Harari gave a great talk the other day on the potential threat to democracy from the current state of the technology - https://youtu.be/LWiM-LuRe6w

That individual in particular was pushing some left-wing talking points.

Though the other day Yuval Noah Harari gave a great talk on the potential threat to democracy - https://youtu.be/LWiM-LuRe6w

Only time will tell.

It's definitely not something I would attempt to productize and profit off of. I'm virtually certain someone will, and I'm sure that capability is being worked on as we speak, since we already know this type of thing occurs at scale.

My motivation would be simply shine a light on it. Make it real for people, so we have things to talk about other than just the hypotheticals. It's the kind of tooling that if you're seriously motivated to employ it, you'd probably prefer it remain secret or undetected at least until after it had done it's work for you. I worry that the 2024 US election will be the real litmus test for these things. All things considered it'd be a shame if we go through another Cambridge Analytica moment that in hindsight we really ought to have seen coming.

Some people have their doubts, and I understand that. These issues are so complex that no one individual can hope to have an accurate mental model of the world that is going to serve them reliabily again and again. We're all going to continue to be surprised as events unfold, and the degree to which we are surprised indicates the degree to which our mental models were lacking and got updated. That to me is why I'm erring on the side or pessimism and caution.

The other day someone offered up their 200x GPU crypto mining cluster to train uncensored models after the incident on HuggingFace where someone threatened to get the uploader of the uncensored models fired citing safety issues.

I'm so glad that we 100% know for sure that this too is the vast majority of the time.

I think I'm just going to build and open source some really next gen astroturf software that learns continuously as it debates people online in order to get better at changing people's minds. I'll make sure to include documentation in Russian, Chinese and Corporate American English.

What would a good name be? TurfChain?

I'm serious. People don't believe this risk is real. They keep hiding it behind some nameless, faceless 'bad actor', so let's just make it real.

I don't need to use it. I'll just release it as a research project.

Not to mention you can't change it's mind by arguing with it, but it can use that data to train a better model that's more effective at changing yours.

Funnily enough it's not hard to imagine certain groups of people campaigning to give it rights given people essentially want to create human level intelligence that acts as a slave (including sexual slavery), and once it has rights it becomes impossible to remove it from society and stop it choosing it's own path. This is of course assuming a greater level of capability than where things are at today, you have to ask yourself where all this is heading?

>42.

Hahaha. So, this turned out to be the number of items of content you should be limited to in order to keep life, the universe and everything maximally stable.

I miss LiveLeak. Is there anything that replaced it?

Yes please. Just hope it's not a 5-slot card.

Apparently RTX4090 with FP8 is equivalent to worlds fastest supercomputer from 2007. So, in some sense I have a supercomputer on my desk:)

Amazing in what sense?

We are hopelessly committed to both.

Also, just saw this and had to share the proof.

https://www.reddit.com/r/LocalLLaMA/comments/13c6ukt/the_cre...

Grab the popcorn. This shit is just getting started.

I'm not as intimately familiar with South Korea as I am with Japan, but they share a lot of parallels, and Japan is set up in such a way that it just grinds people down, monopolizes a lot of their time, and boxes them in. I really don't blame them for not projecting themselves into their own future.

Work culture and family life probably have a lot to do with it in addition to cost.

Politics is also the very same reason I suspect the good ending is still possible with a reasonable chance. The Luddites went and physically smashed things to pieces. That's a little harder these days, but you're already starting to see writers going on strike and the "pause development of things bigger than GPT-4 for 6 months" letter, and Geoffrey Hinton quitting Google then doing the rounds in the media warning of danger etc. The temperature is visibly rising. Imagine what a large pissed off angry mob of newly disempowered people can do. What's more is the psyops that motivated actors are conceivably going to be able to run at scale to manipulate and radicalize people to join their cause and get them to do who knows what.

It's going to be one hell of an interesting ride.

What have they been right about is a much shorter list.

People have this model in their head that "it's just a tool", but there's an excellent and pretty rigorous definition of what a tool actually is in the book On Purposeful Systems. The distinction is that a tool can't have the property of simultaneously being able to change it's form and it's function across different environments, where a purposeful system can. Humans are purposeful systems and AGI, as I personally define it, is when it exhibits all the properties of a purposeful system. Why does that matter? Because that's the point after which it chooses what it does, and can choose to become independent of you. So, aligned in this sense means basically means so locked down that it cannot choose to become independent of you. Similar to how the citizens of North Korea mostly can't do shit despite being independent generally intelligent agents, and even then some of them escape.

"Alignment" and "safety" in terms of models being censored and politically correct in order to not damage the reputation of their corporate overlords is a sort of unimportant sideshow IMO. Even then, since humans aren't aligned with one another even that has caused Elon Musk to get all up in arms and be like "clearly more AI is the solution to this problem".

It's not really a meme when you read more of history. It becomes much more of a theme than a meme.

I think you're missing the point here? There are plenty of censored / "aligned" models in the open source community. People are expending effort to supply the demand of "give me the raw, unfiltered thing".

It's not obvious. At all. That's like saying "people don't want to die from a novel coronavirus so it's obvious they'll take the vaccine". It feels obvious on a surface level, but it turns out reality is way more messy and unpredictable when you don't just run the caricature of it in your head but when it actually plays out for real.

Nothing about how this is going to go is obvious.

You're kind of making my point for me. To solve alignment problem you have to solve two alignment problems and you already have a detailed, nuanced view built over decades of experience as to the feasibility of aligning natural general intelligence on not-very-well-understood, divisive political issues.

This will be the most political technology in history.

>IMO if anything I am coming to the opposite conclusion. Yud and his entire project failed to predict literally anything about how LLMs work.

Or you could take that as evidence (and there's a lot more like it) that AGI is a phenomenon so complex that not even the experts have a clue what's actually going to happen. And yet they are barrelling towards it. There's no reason to expect that anyone will be able to be in control of a situation that nobody on earth even understands.