hehdhdjehehegwv

The phrase “unsustainable gigantic moral hazard” applies to the current pharmaceutical and health industry. You know, the one that killed millions with opioids.

As far as I am concerned, burn it all down and put the most unhinged cokehead VCs in charge, who cares at this point. Hell, add some crypto AI NFTs in the mix while we’re at it.

Literally cannot get worse than it is now.

I guess that would make AppleCare a bucket of compost.

Sell NVIDIA, buy buckets of worms, profit.

Literally all smartphones dying at once is preferable because they are all backed up into heavy duty databases. You can restore every phone from the cloud in this thought experiment.

You can not restore a data center from a pile of phones.

I didn’t comment earlier so I can’t move a goalpost I never set down. I agree with the root comment that there may be more instances of SQLite, the most important data is not in SQLite.

For what it’s worth, I have used any number of databases over the years and SQLite is very good for a number of things.

None of those things are the core infrastructure that stores your emails, money, and other must have, shared, high availability data.

There are different tools for different jobs, that’s fine.

It most definitely does and I’m serving several read-only production databases from memory. It is insanely fast if you do it right.

https://www.postgresql.org/docs/current/pgprewarm.html

The number of societal-wide problems that occur if your Lightroom database gets corrupted is zero.

The amount of hell that would be unleashed if the financial systems layers upon layers of database transactions got broken is impossible to comprehend.

So if you mean “important” as “necessary for society to function”, then no, your browser bookmark files, contact list, or the other two dozen things your laptop and phone use SQLite for are not important.

Yeah and the GitHub for .cpp links directly to ollama - it’s literally advertised by the core maintainer as a good project.

Yeah, I’m busy doing actual work - Ollama acting as a wrapper is exactly what I want.

I answered the financial thinking in another reply, but another factor is I need to know if the model today is exactly the same as tomorrow for reliable scientific benchmarking.

I need to tell if I change I made was impactful, but if the model just magically gets smarter or dumber at my tasks with no warning then I can’t tell if I made an improvement or a regression.

Whereas the model on my GPU doesn’t change unless I change it. So it’s one less variable and LLM are black box to start with.

I may be wrong for Gemini, but my impression is all the companies are constantly tweaking the big models. I know GPT on Monday is not always the same GPT on Thursday for example.

So my main motivation is not so much to have the lowest cost, but to have the most predictable cost.

Knowing up front this is my fixed ML budget gives me peace of mind and gives me room to try stupid ideas without worrying about it.

Whereas doing it in the cloud you can a) get slammed with some crazy bill by accident, b) have to think more about what resources testing an idea will take, or conversely c) getting GPU FOMO and thinking “if just upgrade a level all my problems will be solved”.

It works for me, everybody mileage varies but personally I like to budget; spend; and then totally focus on my goals and not my cloud spend.

I’m also from the pre-cloud era, so doing stuff on my own bare metal is second nature.

I’m doing non-interactive tasks, but in terms of the A6000 running llama3 70b in chat mode it’s as usable as any of the commercial offerings in terms of speed. I read quickly and it’s faster than I read.

Doing really nuanced classification of documents at very large scale. Needle in the haystack type problems.

Nope, powers some low-level infrastructure-ish stuff.

Absolutely phenomenal.

It’s hard not to think this is just the FAA trying to protect Boeing again by making it look like Airbus is equally bad.

FAA should just be rehoused under department of commerce where the job is actually to promote and protect American business interests.

At least then we can admit we have no regulatory oversight of aviation safety. Let’s be honest as a country for once.

At least their extortion is polite?

I dropped $5k on an A6000 and I can run llama3:70b day and night for the price of my electricity bill.

I’ve gone through hundreds of millions, maybe billions, of tokens in the past year.

This article is just “cloud is expensive” 101. Nothing new.

This is why you need proactive privacy evaluations before you ship.

The standard of the past 25 years of “let’s violate every privacy law and know it won’t catch up with us” is over.

You either ship privacy complaint product, which means painful and slow review and adjustment which is an obvious financial cost…OR you go to market out of compliance, get slammed by the press and regulators, and the entire project eats shit.

What seems like short-term cost saving is really just torching the entire investment.

The underlying reason Boeing planes fall out of the sky and these privacy hostile products fail is the same: speed and greed.

I read that article earlier, but it didn’t mention Boeing so I wasn’t questioning it.

But where Boeing goes, bad things follow.

Starting today we are using solar power so Gemini can generate infinite scammy blogs and websites.

Google Search will then use hydropower to index this LLM spam into our search engine.

Next, our wind powered Display Ads network turns visits to these sites into positive revenue.

We have achieved a purely self sustaining business run 100% on renewables.

A first for Google, and a first for the industry.

But there’s more.

Without the need to feed, house, and support human content generators we are making even bigger cuts to our impact on the planet.

By close of 2025 we aim to eliminate thousands of jobs, leading to huge carbon savings across the board.

Arrival and Dune Part 1 are both really good, 10/10, adaptations.

Dune 2 to me shows that even with an amazingly talented adapter/director, that there are some limits to what can be conveyed from literature to film.

The limit in Dune 2 comes down to the fact that much of the “action” in the novel takes place via internal monologue. To convey that in film ends up being very, very hard and with Dune you can’t escape it.

In my viewing of Dune 2 I thought they weren’t able to really show the vastness of Paul’s internal journey, his visions of Jihad, struggling with his place in the universe as his mind is transforming. I didn’t feel that was in the film and made a lot of other actions and motivations more confusing.

I’m glad we have so many ways to tell stories, and I’m wholeheartedly for adaptations, but the fact that some types of ideas and stories are best expressed via one medium over another is something to embrace as well.

She’s low-key one of the most successful engineers ever in terms of bringing cutting edge technology to the mass market, but AMD never gets the fawning press attention of NVIDIA, and still has the lingering image of being the poorer cousin of Intel.

Of course, as a woman engineer to make it this far she’s used to not getting the limelight in a male dominated industry - which may also explain some of AMDs recent success.

Really well done, enjoyed it.

The WWDC show got on my nerves with the corpspeak, but this is pretty cool stuff.

I’ve been trying to make smaller more efficient models in my own work. I hope Apple publish some actual papers.

My favorite thing with names is I have some people in my contacts who have names that are phonetically similar to English words. When I type those words in a text or email, Siri will change those words to people’s names.

Ah yes, them saying “we’re bad at it on purpose, but are scrambling to throw random features in our next release” is definitely a great defense.

Apple bought Siri 14 years ago, derailed the progress and promise it had by neglect, and ended up needing a bail out from Sam once he kicked their ass in assistants.

Call it whatever you want.

It came from Google employees who left to found startups.

Google had technical founders, now it’s run by MBAs and they are having a Kodak Moment.

There’s a lot I don’t like about Sam Altman. There’s a lot I don’t like about OpenAI.

But goddamn they absolutely leapfrogged Google and Apple and it’s completely amazing to see these trillion dollar companies play catch-up with a start-up.

I want to see more of this. Big Tech has been holding back innovation for too long.