Hacker News Reader

huseyinkeleson Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

I just used their `Bonsai-demo` repo like this;

`cd ~/Code/Bonsai-demo && BONSAI_CTX=65536 ./scripts/start_llama_server.sh`

then used it in a very minimalistic pi with a very small system prompt.

Didn't spend much time to try to optimize it tbh, but my issue was not the speed. it just could not make a decision on how to implement the task, kept going on an on.

huseyinkeleson Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

I tried this one, but I found Ornith1.5 to be a better MoE model for me, also very fast. But I still couldn't make it implement a real task on a real repo :( it only worked with an extremely clear directions and very small tasks.

huseyinkeleson Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

Testing on a MBP m4 pro 24gb

~100t/s prefill, ~15t/s, dropping to ~10t/s later with 64k context.

The issue is I have yet to find a useful agentic local llm that I can run on this machine.

Just given a relatively simple task on a swift app, took 25 minutes, brainstorming like crazy but can not decide on what to do. Eventually I killed it. GPT 5.6 sol-medium took 3 minutes to complete the same task for reference.

huseyinkeleson Astra for Law

when you shoot someone with a gun, who gets sued? you? or the gun manufacturer?

huseyinkeleson Amazon vs. Perplexity – U.S. Court of Appeals for the Ninth Circuit

what's next? suing Chrome because it logs in to amazon on my behalf after i give it my amazon credentials?

huseyinkeleson 11,000-year-old sculpture of man riding a leopard found in Turkey

I spent so much time looking at it, how do they see a leopard there?

huseyinkeleson Octopus intelligence may be related to never-before-seen mutation

I heard this many times before, same thing with the pigs as well, which are another very smart species of animal.

Based on the same logic, is it ethical to eat a human if they are mentally disabled or not passing some IQ test?

huseyinkeleson Why your local LLM feels dumber than it is

I don't know why but your post was marked as [dead] for some reason. Just vouched for it.

huseyinkeleson Ornith-1.5: From Self-Scaffolding to Self-Improvement

I've been experimenting with it on a M4 Pro 24G for the last few hours and it's been very promising using 32k context. getting around 30-40 tps

With Qwen3.8 27B I could not get anywhere near 32k context window, that made it very unusable for agentic coding, although it was very smart.

huseyinkeleson Fermi Paradox

Related to the #4, I recommend the book Roadside Picnic by Arkady Strugatsky.

“What if we finally got visited by aliens but the most important event in or history was simply an intergalactic roadside picnic for the aliens?

They don’t even bother with us ants. They just pull over have some fun for a couple of hours and leave a mess behind…”

huseyinkeleson Kimi K3: Open Frontier Intelligence

Including this comment :) https://news.ycombinator.com/item?id=48851278

huseyinkeleson GPT-5.6

Surely this comment is literally on every new model release post.

huseyinkeleson Cursor Camp

Really love all his work!

Check out the Space Elevator or Size of Life too.

huseyinkeleson Python: The Optimization Ladder

The author is from Turkey (where I’m also originally from).

Believe it or not, when you write a blog post in a different language, it really helps to use an LLM, even just to fix your grammar mistakes etc.

I assume that’s most likely what happened here too.

huseyinkeleson PS5 now costs less than 64GB of DDR5 memory. RAM jumps to $600 due to shortage

A great example for the pork cycle.

https://en.wikipedia.org/wiki/Pork_cycle

huseyinkeleson Helping Valve to power up Steam devices

That’s what happens when you don’t need to please the shareholders.

huseyinkeleson NanoChat – The best ChatGPT that $100 can buy

Karpathy says nanochat will become the capstone project of the course LLM101n being developed by Eureka Labs.

I guess it’s still a work in progress? Couldn’t find any other information elsewhere.

huseyinkeleson Remembering Steve Jobs

What do you think would happen to Woz if he never met Jobs?

I’m sure he would’ve been a very successful engineer regardless but I doubt we would even know his name.

I’m not saying this to dispute his achievements etc. But it’s very one sided to attribute all the achievements to either one of them.

huseyinkeleson Markov chains are the original language models

https://www.reddit.com/r/SubredditSimulator

Seems like it stopped around 5 years ago.

huseyinkeleson Detecting and countering misuse of AI

I believe you are referring to “lamer” (as opposed to hacker)

huseyinkeleson Abogen – Generate audiobooks from EPUBs, PDFs and text

I can hear it on safari

huseyinkeleson QwQ-32B: Embracing the Power of Reinforcement Learning

I read somewhere which I can't find now, that for the -reasoning- models they trained heavily to keep saying "wait" so they can keep reasoning and not return early.

huseyinkeleson Claude 3.7 Sonnet and Claude Code

Okay, I feel like there might've been a breakthrough here. After watching Karpathy's video [0], he mentioned how hard it is for LLMs to have humor and be funny but it seems like Claude 3.7 really nailed it this time?

Like, most of these posts are legit funny.

[0] - https://www.youtube.com/watch?v=7xTGNNLPyMI

huseyinkeleson Ask HN: What indoor CO2 monitor do you recommend?

If you want to go DIY route; I use MH-Z19 sensor along with an ESP-32 which has ESP-Home installed on it, works very well and I log the data on Home Assistant.

huseyinkeleson [dead]

TLDR: They are planning to not to include the Apple logo stickers in the boxes.

huseyinkeleson Microsoft CTO: Thoughts on OpenAI (2019)

This video [0] was from 2010s, and seems like they had similar issues even back then. (never worked at Google)

[0] https://www.youtube.com/watch?v=3t6L-FlfeaI

huseyinkeleson Berlin's techno scene added to Unesco intangible cultural heritage list

I enjoyed Zur Klappe when I visited Berlin pre-pandemic times. It's literally underground and used to be a public toilet.

And it's very close to the famous Mustafa's Gemuse Kebab, so you can try that afterwards.

huseyinkeleson Show HN: Control Panel for YouTube

As annoying as it is, I remember a channel I subscribed to once mentioned that they did a little AB experimentation and turns out “surprised face” thumbnails do actually attract more views.

huseyinkeleson 23andMe is reportedly turning the blame back on its customers

When you are able to log in, you then see who are related to you as well. I believe the news sites use those inflated numbers to make it more dramatic.

huseyinkeleson 23andMe is reportedly turning the blame back on its customers

From what I read, people got their credentials breached on some other websites. Hackers then somehow used those same credentials to log in to 23andMe.

I see that 23andMe could’ve forced MFA, or have a better brute force protection for sure but seems like 23andMe themselves didn’t breach any passwords at least.