HNHacker News
TopNewBestAskShowJobs

lettergram

13,302 karma · joined September 26, 2010

Founder @ IP Copilot Inc.

Founder, AI Researcher, Staff Engineer, etc.

Interested in robotics, human-computer interaction, computer vision, neuroscience, mathematics, deep learning, biotech, life.

Feel free to visit me at,

Startup: https://ipcopilot.ai

Website: https://agw.io

    Blog: https://austingwalters.com
    Github: https://github.com/lettergram
    Twitter: @austingwalters
    Email: austin - at ~ agw.io
submissionscomments
lettergram··on Muse – Meta’s personal AI agent
The first example I saw was making a shopping list for school for pick up.

Do the same thing for recipes and buying groceries.

Or "order me take out from a bunch of places I haven't been that you think I'd like." The AI can ask follow up questions and see your ratings.

"Make a music playlist for my daughter when she enters the car based on the conversation last month. I remember vaguely her mentioning what she liked"

These are things that 100% people want AI to do -- imagine if you had a personal assistant, is something people have asked for since forever.

Now, I kind of agree on the minimal use compared to business, because in business everything has always been highly integrated. That said, that's changing rapidly.

lettergram··on Isar Aerospace reaches orbit and deploys payloads on second flight
Literally every campaign promise he's went back on. So, "Saying that maybe this is actually what it means to be an American could hold some truth" I don't really think is accurate lol

I know a lot of folks who voted for the man, almost all of them would love for a competent alternative. Unfortunately, in the last election, neither were competent, so a lot of it was a coin toss.

lettergram··on Babylonian Lamb Stew with Beets (1750–1730 BCE)
If you like this, you may like the "Tasting History" YouTube channel - https://www.youtube.com/@TastingHistory

He basically covers a different historic dish every week ranging from the oldest recorded dishes to cafeteria food from 1990; or what they served on the Titanic, etc.

It's a great channel, and covers history well.

lettergram··on Judge rules Trump administration’s blacklisting of Anthropic was illegal
Judges at this level often do things like this, and given it was brought in California likely the next level would also block the administration. That said, the Supreme Court has been pretty clear that the executive branch has broad and the only authority to designate supply chain risk. That said, they do need to justify it, not sure they did it well enough here, but this is far from an impartial judge.

Also, judges are political appointees -- This one has ruled against the Trump administration repeatedly and it's why this case was brought here. She was appointed by Joe Biden, was born/lives/works in the Bay Area and has a track record.

lettergram··on Judge rules Trump administration’s blacklisting of Anthropic was illegal
This would likely be overturned if the federal government needs to push it. At the time Anthropic was saying publicly that they oppose certain actions and their model is restricted in certain ways. The executive branch viewed that as a risk and has the ultimate say over it's vendors, regardless of the judges ruling. The supreme court has been pretty clear on this.

This is also a reminder that, contrary to popular understanding, judges are indeed political appointees. This one was appointed by Joe Biden, works in the Bay Area and definitely has a political bias in both the track record and in activism.

https://grokipedia.com/page/Rita_F._Lin

lettergram··on Universal Health Coverage Could Save $1T and 114k Lives a Year, Yale Study
Ah yes, the claim free money would save lives!

The truth is once systems like this are implemented they change the dynamics of the study and as such could hurting lives.

As a simple example, the biggest cost to the healthcare system in the US is dialysis. Many of those folks already have health issues, and by both dialysis and for all the issues that caused the need for dialysis in the first place is a massive strain. The direct cost of dialysis is $33B annually [1], but indirectly is probably at least another doubling.

Further, the way the government has imposted monopolies in the space already has caused costs to balloon. While making it "universal" could mean the government gets control, and can limit the explosion. It can also could result in weird incentives like Canada, where they're promoting MAID.

[1] https://pmc.ncbi.nlm.nih.gov/articles/PMC8729831/

lettergram··on Illinois just passed a law that puts Linux on the hook for age verification
I think you’re missing the real purpose vs the stated purpose.

The point is monitoring everyone, age verification requires you to share who you are.

lettergram··on Civilian plane crash in New Mexico tied to military GPS blocking
After reading the story, it seems like lack of training. I think training should assume GPS goes out (which it does), in this case they didn’t pull up when they saw “lights going out” as a mountain became between them and the airfield.

Air traffic control also failed here.

lettergram··on Ten advances in mathematics and theoretical computer science
Objectively?

> Democratic Party platform is aligned with national polling on every one.

It depends on the pollster and where you're polling. I guarantee you rural Tennessee will not agree with downtown Washington DC on any of these issues. In contrast, rural California will likely agree with rural Tennessee. It's not as cut and dry as a homogeneous national poll of 2500 people. Every state, city, county are different. That's why there are federal, state, city, and county governments.

For instance, Abortions are legal nationally. States can individually decide how, or if, they wish to restrict it. This is as the constitution intends under the 10th amendment:

> powers not delegated to the federal government nor prohibited to the states are reserved to the states or the people.

This allows for democracy to take place at the local level, rather than having particular regions thousands of miles away from each other ultimately oppress the other.

To the point on LLMs, I think it's abundantly clear they will be used to propagandize and similar to social media will lock people in a bubble without alternative opinions. It'll be the worst of both worlds, the question is who's the puppet master. At some point soon, I imagine it'll be the AI.

lettergram··on Ten advances in mathematics and theoretical computer science
> My guess is that, in the US, the right will cynically adopt manipulation to great effect and the left will take a moral stand against shady practices and lose elections.

I think that statement may itself highlight how prevalent manipulation is.

I fully anticipate all groups to continue maximal manipulation they can. One thing with LLMs is that it'll be a far less unified view, so a "divide and conquer" strategy is what I anticipate.

lettergram··on Taylor Farms Called White House to Try to Delay Cyclospora Recall
It was a false positive for what it was worth - https://www.nbcnews.com/health/health-news/fda-says-taylor-f...
lettergram··on China’s open-weights AI strategy is winning
Unfortunately, the AI being locked down and proprietary is the winning strategy for these companies.

My company hosts its own models. Some customers require us to use either US / EU models, while others are fine with us using any model.

As such, we have two GPU clusters, the general AI cluster runs a Chinese model as it's the most accurate and robust. The US/EU required ones have a few percentage points lower on our accuracy metrics and we provide them those that require it for an extra fee.

Why host at all? Because it enables us to get much higher margins than competitors, while reducing costs. Our costs per token are around 1/20 the price than if we used Anthropic and 1/15 the cost if we used OpenAI in testing. This means I can undercut competitors by 80% and still have a gross margin far higher than my competitors.

In reality, these US AI providers are jacking up the prices and trying to implement regulatory capture. I'm actually fairly confident they'll succeed. At some point, I'm expecting the US / EU administration(s) to block foreign based model, at the same time, they'll probably invest in Anthropic and OpenAI.

What Anthropic and OpenAI are doing is using "safety" as a wedge, just like large corporations used "environmentalism" or "food safety" or "workers safety" as a wedge to regulate smaller competitors out of the picture. Then they jack up rates, sue and/or buy anyone who can potentially be a threat. It's the #1 threat to our business model.

Our competitors are giving half of their margin over to these large AI service providers, we keep the vast majority of ours. Eventually the AI service provider will be able to squeeze them even more until the margin just isn't there and either they are purchased or replaced via internal tools at the company they sell to.

lettergram··on China's open-weights AI strategy is winning
If you're self-hosting a model as a startup (e.g. using GPUs), you're almost certainly using a Chinese model. If your a startup outsourcing (e.g. using tokens), you're going to be using a US based model
lettergram··on John Deere owners will get the right to repair equipment under FTC settlement
As a tractor owner. Two things, the DPF & SCR (>=75hp) on a tractor is not a great idea --

1) Tractors are typically owned by low margin businesses (i.e. farmers) that need to be repaired in the field AND need to be repaired quickly, else you loose a crop. Adding complexity to tractors literally can cost the farm.

2) The actual emissions reduced is questionable. Tractors run significantly less than a truck, like 50-100x less often. Further there are at least 2x more trucks sold per year

3) To run the SCR system, the engine had to run hot for like 20 minutes burning extra fuel and required DEF (yet more input costs)

3) The emissions they are trying to reduce with the these are likely not excessively harmful from a tractor; largely because most tractors who need an SCR system is >75hp, which also means they're typically used on a large farm (100+ acres). Which dissipates the risks substantially.

For reference my 2022 Kubota tractor repeatedly had issues with the DPF / SCR system, mostly the software to enforce environmental rules. This lost us ~$20k one year due to the tractor being knocked out for a week (I was mid-cut for 140 acre hay, rained & rotted in the field post-cut).

For reference, I was very much ready to bypass the SCR system, but decided against it to keep the warranty. It had nothing to do about "right to repair", I figured out exactly how to bypass it.

lettergram··on Every new car sold in the European Union must include a driver monitoring camera
The stats come from the government agency in the US which tracks driver fatalities.

Here's the source document: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/...

Regarding "distracted driving" causing cyclist fatalities, my point was more that bicyclists have a higher risk rate. If we're already going down this path for safety, banning bicycling would have a higher impact than reducing fatalities ~10% which is what the EU claimed it could prevent.

Regarding the claim that "pretty much all fatalities on bikes are the result of being killed by drivers", that's simply not true. It also largely depends on laws and location.

https://www.bikeattorney.com/bike-accident-common-causes.htm...

https://www.npr.org/sections/health-shots/2011/05/20/1364622...

lettergram··on Every new car sold in the European Union must include a driver monitoring camera
> incredible amount of killing from distracted drivers

> 1.10 fatalities per 100 million vehicle miles traveled

https://www.transportation.gov/briefing-room/trumps-transpor...

For reference, fatalities on bikes:

> 9.32 fatalities per 100 million cyclist miles (6 deaths per 100M kilometers)

https://www.calbike.org/urban-transportation-research-bike-f...

lettergram··on Notes from the Mistral AI Now Summit
We actually found the Mistral Small 4, quantized to 4bit was comparable to Qwen 3.6 27B and is roughly the same size. At least from our experience on our use cases, the quantization of the Mistral model worked far better than trying to quantize the Qwen family.

Fully agree to your point though, Mistral in general is far behind where I'd expect and Qwen in particular is crushing it at the smaller sizes.

Personally, I'd consider anything 20B params and above a "medium" model. Small being <20B and large >100B. I think obviously we can get to the huge 1-2T param models, but frankly the margin of accuracy improvement for the speed hit is kinda insane (1-2% for many metrics).

lettergram··on Alberta startup sells no-tech tractors for half price
Yup, that's pretty much what I was saying for the above. I had a Kubota and can indeed attest to the issue(s).
lettergram··on Alberta startup sells no-tech tractors for half price
They're both considered medium tractors with similar weights for a similar purpose. I forget the official weights, but it's something like 100-175HP is mid-tier.
lettergram··on Alberta startup sells no-tech tractors for half price
You can get a kubota M5-111 with a closed cab for $70k-100k, cheaper than these. Plus zero percent financing though then for 5-7 years. Well built and a comparable class in terms of weight and horse power.

People aren’t buying them for price, but the first sentence discusses it as if it’s relevant.

My assumption are farmers are trying to skirt the eco rules for vehicles in some way. Which by the way is insanely annoying and has caused issues for all the farmers I know at one point or another. Worse, you can’t fix the ecosystems on your own so you have to get them serviced costing quite a bit and importantly putting your tractor out of commission for a while. It’s why older tractors have a premium

lettergram··on OpenAI backs Illinois bill that would limit when AI labs can be held liable
Clicking the link splits off the ".", which is interesting but necessary.
lettergram··on OpenAI backs Illinois bill that would limit when AI labs can be held liable
You can buy books on how to make and obtain chemicals on your own.

Hell here's an Internet Archive book on making explosives

https://archive.org/details/saxon-kurt.-fireworks-explosives....

If you ever chat with older folks pre-90's much of this information was accessible fairly easily. It only changed with the push by the government to crackdown on Waco, Oklahoma City bombing, militias and other related groups. There was then a campaign to make it "normal" to limit free speech on the subjects, where as these books were available before.

I think the whole thing where AI should make information less available is a difficult battle and one which I personally oppose, but do understand. Free speech and information isn't the problem, it's the people, actions and substances they create.

After the age of the internet, I think it's been a forever loosing battle to limit information, it's why we couldn't stop cryptography, nuclear weapon proliferation, gun distribution, drug distribution, etc. The AI is just another battle ground, one which, if they actually do manage to control could definitely create some walls to this information, but not stop it.

More scary, is that the AI as it becomes pervasive and stop people from asking certain questions, because they don't know they should ask... but that's unrelated to the risk of mass death.

lettergram··on Ask HN: Is it still worth pursuing a software startup?
There's still plenty of moats frankly, same moats as before. What isn't the moat is the software development time.

In our case, we're building a tool that has a moat from: integrations, multiple parties connecting, and others

It's very sticky once we get in, and has nothing to do with the software so much as legal, company policy and inter party communication

lettergram··on PBS News Hour West to go dark after ASU discontinues contract
When I read that I'm always personally confused. He had a commanding voice and had an aurora of being above it all. But when you listened and watched what he actually did, he seemed very political in my mind, though perhaps more of a moderate(?).

He even advocated for world government, endorsed politicians, etc.

lettergram··on “Super secure” messaging app leaks everyone's phone number
1000 downloads lol

https://play.google.com/store/apps/details?id=com.freedomcha...

lettergram··on “Super secure” messaging app leaks everyone's phone number
All 1000 downloads...

https://play.google.com/store/apps/details?id=com.freedomcha...

lettergram··on “Super secure” messaging app leaks everyone's phone number
Feels a little like clickbait "MAGA-themed", never heard of Converso.

That said, the analysis itself is interesting and worth a look, if nothing else it's a general pattern you can follow for many chat applications to see how secure it is.

lettergram··on Recovering Anthony Bourdain's Li.st's
Bourdain actually joked about killing himself in the exact manner and location in, which he did. When I heard it happened, my wife and I both recalled the same times he'd mentioned it. It wasn't a surprise really.

Bourdain had been referencing Hunter S Thompson and the way he went out for years. He'd also repeatedly mentioned wanting to go out in southern France after a great day. Bourdain generally had the same "vibe" as Thompson as well. Here's Thompson's last note to his wife:

> No More Games. No More Bombs. No More Walking. No More Fun. No More Swimming. 67. That is 17 years past 50. 17 more than I needed or wanted. Boring. I am always bitchy. No Fun—for anybody. 67. You are getting Greedy. Act your old age. Relax — This won't hurt.

To me, it wasn't a surprise at all. My wife and I even had discussed when we thought it would happen. The main thing about Bourdain was that people could relate to him and he wrote excellent prose. He seemed authentic and he went out on his terms, which is what he wanted and was the way he lived.

lettergram··on Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model
There’s a lot of indications that we’re currently brute forcing these models. There’s honestly not a reason they have to be 1T parameters and cost an insane amount to train and run on inference.

What we’re going to see is as energy becomes a problem; they’ll simply shift to more effective and efficient architectures on both physical hardware and model design. I suspect they can also simply charge more for the service, which reduces usage for senseless applications.

lettergram··on Fire destroys S. Korean government's cloud storage system, no backups available
The irony -- so not only was their system hacked ("hosted onsite"), but then it was also burned down onsite with no backups.

In other words.. there was no point in the extra security of being onsite AND the risks of being onsite single failure point destroyed any evidence.

Pretty much what I'd expect tbh, but no remote backup is insane.

Page 1 of 34Next →