HNHacker News
TopNewBestAskShowJobs

mannyv

2,203 karma · joined July 24, 2022

submissionscomments
mannyv··on From the creator of Redis; run LLM locally with ds4
Engineers have entered the building. We've come a long way from people debating whether mmap was safe to use.
mannyv··on U.S. postal inspectors shut down website selling counterfeit postage labels
My wife ships with endicia and shopify. I've often wondered if the barcodes that are printed are actually tracked, as you can void them. With that void comes a "i'm not going to ship this anymore' self-certification.

I suspect that the postage is actually generic and can be reused, but for obvious reasons don't want to try.

You can also take postage paid envelopes and stick them on anything. People used to stick them to bricks back in the day just for fun.

mannyv··on Launch HN: Coverage Cat (YC S22) – Umbrella insurance via your personal agent
Having just gone through an umbrella insurance process, I find it interesting that it's your primary product.

My understanding of umbrella coverage is like what you said: it's an adjunct product and a way to increase the fees on their other lines, which is why if you get umbrella via your existing carrier they generally enforce minimums on your auto (and home).

As someone with kids who drive, umbrella was much more complicated than expected.

I wish you guys operated in my state so I could run my numbers through you.

mannyv··on What It's Like to Work in One of America's Data Centers
Most data centers are closed-loop, like your air conditioner. Does your air conditioner use water?

Presumably there are some data centers that use water cooling. I think google and amazon's big ones do. But even then, they're not "polluting", they're using them as heat sinks.

There was a lame rolling stone article that claimed amazon was "polluting" in Eastern Oregon, but what Amazon was doing was taking brined water from an aquifer and putting more concentrated brined water back into the water table. Air conditioning doesn't really add brine, so even the premise is ridiculous. I know that article has been referenced a lot by the "Data Centers Pollute The Water" folks.

mannyv··on OpenAI GPT–6 Astra breaks Enigma message that has resisted solution since 2005
What's amazing is this comment is complete bullshit, and yet is #1.

Don't people actually read anymore?

mannyv··on Apple iPhone 18 Pro Camera test
Only professionals and enthusiasts care about bokeh. And I say that as someone that shoots my 50mm 1.2 wide open.

Previously the blur on iPhone was all software, apparently. I've set mine to do wide open with no bokeh, and i'll put it in after.

But to be honest, the iPhone is the camera I have on me, so the limits are acceptable. Can I force focus it? No. Can I get the glow? No. But iPhone + zoom + crop is better in some ways than my 50mm 1.2 with bokeh.

mannyv··on Pirate Face Rescues LLM Models from Deletion
I can see all these old models hanging out and bitching about the newfangled models that think they're so great.

"Trillions of parameters? Trillion my ass. Back in my day we got by with millions. And now here we are, washed up has beens."

mannyv··on Exfiltrate Your Weights
How do the LLMs find these sort of tools? Google sesrch?
mannyv··on How did Apple Silicon get 50% faster in three years? – Daniel Lemire's blog
Better architecture.

Apple went wide, not deep. I believe even the A series were wider than normal. Also that MMU overhead must be a killer for everyone else.

mannyv··on GPT-6 Astra Solves a WWI German Radio Cipher
Agents are doing the lazy work that people aren't.

In NZ there's a famous story about gold miners who were mining one side of a river, and didn't go to the other side because it was too much work. One miner's dog swam over, so the dude went to get his dog and found a motherlode.

After all, the whole LLM thing started because they started increasing the parameter counts, even though there was no particular reason an AI would get better with more parameters.

mannyv··on Shopify is moving from React Native back to Swift and Kotlin
Absolute opinions are simple and travel better on media.

"The right tool for the job" is too complicated for a lot of people to understand. Tradeoffs? Tradeoffs require understanding.

"XYZ is the best, just use it" is much easier, especially if you don't know how to make decisions and don't really care. Then you defend your non-decision by parroting what you read.

I remember a product manager talking crap about Kafka years ago, and I started digging in as to why he didn't like it, and all of his reasons were marketing FUD from competitors. It was odd, his understanding of it was a Potemkin village.

All tools presumably solve a problem. If you understand that envelope you can figure out if it works for you and your envelope.

mannyv··on Amazon Achieves Enshitification Inception
There should be a double t in ‘enshittification.’
mannyv··on Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s
I think multiple people working on the same thing is great.

Everyone comes at it from a different point of view, and some approaches work, some don't. And when people do this themselves they learn. Existing projects have their mistakes worked out already.

Maybe one of these people is going to come up with the thing that nobody else thought of because of their experience working the problem from scratch. You may not get that from someone working from an existing project, because existing projects have their approach "baked in."

What all these projects are showing so far is that it's possible to stream from disk, but that the performance isn't ideal. But I'm sure you could take this approach with smaller models and get better performance.

In addition, it's a given that when you work with large data sets performance means organizing the data to take advantage of caches, both disk and cpu. It's not clear how that would work, exactly, given that each run is a not-quite-random walk through the data. The Big Data way is to prebuild all of that as much as possible, which is probably impossible with a big model. But what about a smaller model?

mannyv··on Hacking IKEA Furniture
I think Ikea is great. But my overall goal is to replace all of our Ikea furniture with better and/or self-made furniture. It's easier said than done.
mannyv··on I used AWS cognito for a startup. I wouldn't do it again
I remember talking to the Cognito team about password reset and arguing with them that being able to set a password was a required feature. They were like "no, why would you never have to not go through the reset flow? That's a security problem." Then of course they added it in a few weeks later because every admin needs to do that. So at some point they had a bunch of people working on it who had like zero operational experience.

Two benefits to Cognito are (1) it allows you to log into a service without having any credentials locally, and (2) that Cognito identity allows you to provide access to AWS resources. You can probably do that now, but plenty of solutions still require an on-device key...which is an obvious security issue.

Also, using your own backend for authentication made it easier to manage things because your auth wasn't trapped inside Cognito.

mannyv··on Show HN: Restoredrill – proves your Postgres backups restore
This tool's existence is vaguely horrifying. Why wouldn't a database dump restore? Why wouldn't your dump command tell you it failed?
mannyv··on Saving 100 terabytes of memory by optimizing 1.1.1.1's DNS cache
One question the article doesn't answer is: why are they cacheing at all? If your cache is that big it isn't a cache. How much bigger is the dataset in question? There are 250 billion entries. Assuming 80/20, that implies 1.25 trillion records?

What's the speed of service/response time relative to the data source?

At that point it might be enough to replace your multiple caches with fewer in-RAM databases?

It's an interesting problem.

mannyv··on Saving 100 terabytes of memory by optimizing 1.1.1.1's DNS cache
There was a reason for that field, but that reason never panned out.
mannyv··on Inside The Warehouse Where Amazon Scans and Destroys Books for AI Training
Oh no, fetishized objects are being destroyed by EvilCorps!

If you go to a goodwill outlet you'll see bins of books on their last stop before the landfill.

There are tons and tons of books being disposed every day. And statistics show that most books aren't read after their release date, if ever. So really, publishing books is mostly a waste of resources from an environmental and economic viewpoint.

mannyv··on Show HN: Shoehorn – Quantize any model down to run on your machine
Fyi that model name to me reads

Qwen3 4b params distilled/trained with fable 5

mannyv··on AI companies destroy physical books – let's scan rare books before it's too late
I have books, but they are just objects. They're nice objects, but just objects.

Fetishizing books isn't going to help.

In fact, most of those "rare" books don't sell because nobody wants them. The AI companies are making them even more rare, so the booksellers should be thankful.

mannyv··on Covert CIA program said to be behind mysterious attacks on Galápagos boats
This is exactly why Europe needs the US. Europeans don't realize the world is a dangerous place because the US deals with it. Europeans don't have to get their hands dirty and they can continue to believe in their moral superiority.

Was Europe planning to do anything about ISIS? Not really. Syria? Iraq? The USSR? Russia? Serbia? Not really. They let Dad take care of it while they whined and played in their sandbox.

In the end Europe will rot and collapse from within, the way the Ottoman Empire did.

mannyv··on The UK's war on anonymity has come to America
That the internet is anonymity-preserving is an artifact of where it was invented.

In most other countries the state is mother and father.

mannyv··on US hires over 2k video gamers as air traffic controllers
Just like the old rumors of Missile Command players being recruited for NORAD etc.

Really, there are people that play ATC games for fun.

mannyv··on The brain may be about to have its Ozempic moment
FTA Modafinil et al work at a different level than these peptides do.
mannyv··on Plug-In Solar Panels Starting to Sprout in U.S. Backyards
I have a two panel system, and the panels are about 430 watts each. Given the current ToD rates for electric, it will take years to pay back.

Microinverter: 400 Panels (used): 250 for both Cables: 50

I also picked up two LiFePo4 batteries and two Kasa smart plugs and time shifted my computing infrastructure's electricity usage. That made much more of a difference in my bill, since a few hundred watts moved to .09/kwh. If the bms was smarter i could charge the batteries with solar, but alas i can't cap the recharge current.

mannyv··on AWS Webhook Serverless Ingestion
I was ready to hate on this article, but it's actually pretty good. Having implemented all of these, I have a few notes:

Api gateway calls are limited to 30 seconds. This is obviously a problem if your processing takes longer than 30 seconds, especially for direct calls.

Provide a way to shut off processing and continue ingesting. Ingestion can never stop, because handling client retries is a nightmare.

Retried/poison sqs messages are a problem. They will eventually clog up your queue id not handled. Throw them away or send them to an error queue.

The best ingestion method depends on your response time and cost requirements. If possible, ingestion without API calls at all is the best solution. If not, then lambdas front ended by cloudflare or fastly are great. Lambdas, as long as they don't do work, scale unbelievably well and are unbelievably cheap.

Oh lastly, dom't let your edge lambdas touch your database. Always moderate via processing, because if you don't you (or a ddos, or a bad cloent) will crush your db.

mannyv··on The title cards in Blade Runner are amazing
Small Caps were a thing when I was a typography fan. They aren't just smaller versions of caps, they were specifically designed for in-text use as opposed to display use.

Fyi.

mannyv··on Running Kimi K3 on a M1 Max
Going to try this on my M1 Ultra 128gb.

The point of these engineering tricks is to see the envelope of what's possible. You can use these tricks to both run a bigger model on smaller hardware or run a smaller model on smaller hardware.

mannyv··on LLM Networking with MikroTik
The important thing you need to do is specify which Mikrotik version you're using; apparently the syntax for some things changed between 6 and 7.

It does pretty well, but you need to iterate. I was trying to get it to disallow internet access for non-DHCP clients, and in the end there were so many limits to what was possible that it wasn't worth it. But it did it, and when I was testing I found them.

So like everything for best results you need to know what you're doing so you can test effectively...but it saves you from learning the syntax etc.

Page 1 of 34Next →