muricula

Price is confounded by VC subsidies, economies of scale, and inference optimizations. I think a more interesting chart would be ARC AGI vs forwards pass flops or ARC AGI vs training tokens. Of course we don't have those numbers for the closed source models or even some of the open weight ones.

I'm no expert but it seems like a descendent of LSTMs. There's a series of papers which show how to reformulate attention as RNNs which arrives at linear attention. Then they add a decay term to get mamba2. Then they add modified the decay term as like a scale to apply both to the existing state and the new update to get delta net. Then they added a gate matrix on the output to get gated delta net. Then Kimi Linear Attention seems to be gated delta net with a more expressive gate. The Gated DeltaNet paper recaptilulates this evolution decently well. But yeah, it feels like they're starting with the same lego blocks and assembling them in similar shapes to accomplish similar but slightly distinct modules.

Same Armv8 ISA. And it's the same ISA Android Linux has run on for over a decade.

So you don't care if injustice happens to other people, only if it could happen to you?

The host kernel and probably the host VMM can see guest memory, so I wouldn't use it for that.

Python has that property when you don't bring C extensions into the conversation. Data races exist, but can never cause memory corruption due to the GIL.

Usually people are talking about race conditions. When you say contrived you're thinking races conditions are difficult to win and unrealistic but attackers who have a lot of money on the line spend the time to win all sorts of wild race conditions consistently.

I've played with something similar with my M1 using Apple's MLX framework. The problem is I'm compute bound. I've never managed to get my M1 Max's GPU to process more than ~7.8k tokens per second at bf16 precision, so to train a 112M parameter model on ~20 billion tokens I'd need to run the model training for ~30 days.

One solution is to reduce the scope of the problem -- you can train on a smaller less diverse dataset such as TinyStories which is a collection of 1 billion tokens of chatGPT generated children's stories. After about 40 hours, less than one weekend, you'll have a model which can generate mostly grammatical children's stories.

If you have a newer mac and/or an ultra chip you'll have more and faster GPU cores, and might be able to train on FineWeb or a similar, larger and more diverse dataset.

Is there a whitepaper or ISA manual change describing the feature?

Does anyone know what the block dot at 12 o'clock on the image is? https://chipwise.tech/wp-content/uploads/2025/09/A19_SoC_die...

I could be mistaken, but I think the mac studio comes with either an M3 ultra or an M4 max, and the ipad comes with an M4 chip. I think they decided not to make an ultra for the M4 generation, but don't take my word for it.

I think the audio quality gives this recording character. What could be more cyberpunk than hearing the quirky artifacts resulting from ripping an obsolete recording medium?

Look up iMessage's "blastdoor" sandbox: https://support.apple.com/guide/security/blastdoor-for-messa...

That might have been true in the early 2000s when they were growing the Hillsborough Oregon campus but most new fabs are opening in Arizona for taxation and political reasons. I don't have the numbers to back it up, but based on articles about Intel layoffs I believe that Intel has been shedding jobs in Oregon for a while now.

This wiki page has a list of Intel fab starts, you can see them being constructed in Oregon until 2013, and after that all new construction moved elsewhere. https://en.wikipedia.org/wiki/List_of_Intel_manufacturing_si...

I can imagine this slow disinvestment in Oregon would only encourage some architects to quit an found a RISC-V startup.

The article is written for a different audience than you might be used to. oregonlive is the website for the newspaper The Oregonian, which is the largest newspaper in the state of Oregon. Intel has many of its largest fabs in Oregon and is a big employer there. The local news is writing about a hip new startup for a non-technical audience who know what Intel is and why it's important, but need to be reminded what a CPU actually is.

Is that a CPU based inference build? Shouldn't you be able to get more performance out of the M3's GPU?

You may be interested in the new Clang -fbounds-safety extension https://clang.llvm.org/docs/BoundsSafety.html

Tax breaks and politics. https://www.nytimes.com/2023/02/22/technology/arizona-chips-...

You might double check that the way you number the grades is the same as the way the parent comment numbers them. For example, as I understand it, in the US most kindergarteners are 5 years old and most first graders are 6, while in NZ most first graders are 5 years old and most second graders are six. So to convert from US grades to NZ you add one because in the US kindergarten isn't given a number.

The US has a highly regional system, but as I understand it pre-algebra is taught starting around sixth grade (~11 year olds), which may line up a little closer to your expectations.

No dereferences, just casts. It shouldn't generate any loads/reads from memory.

`h` is for "hidden" layers.

Is it just me or does it seem like modules are a good idea which is totally dead on arrival? It's been four years, and we've had a whole new edition of c++ standard in the meantime, and Clang and GCC still don't have full support for modules.

Teddy Roosevelt is both on Mt. Rushmore and in one of the photos generated, so it's definitely not 1 of 4, but 2 of 4 were correct.

It's not setting the fire which causes taxpayers to lose money, it's writing off the loss against taxes you would have otherwise paid on profits made from other movies.

What is this language's approach to memory safety?

Got an error when visiting the page, here's an archived version: https://web.archive.org/web/20240205213635/https://johnnyssw...

FYI I use Safari with a Mozilla produced ad blocker extension. It comes along with their FireFox Focus browser.

Is there a specific paper or something you can point me to? Or are you talking about like llama.cpp? Because I thought that referred to the fact that it was originally one c++ file named llama.cpp?

Does your mac support an external GPU? A mid to high end nvidia card may or may not outperform the M3 GPU at a lower or similar price. You can also stick it in a PC or resell it separately.

How does this language address C's biggest problem, memory safety?