HNHacker News
TopNewBestAskShowJobs

abetusk

5,469 karma · joined July 24, 2014

https://abetusk.github.io

abetusk@mechaelephant.com

submissionscomments
abetusk··on Tiny Brutalism
Hacker News (news.ycombinator.com) started as a link aggregator/message board for the startup incubator Y Combinator [0]. Essentially a place to share projects, share tech news and other internet sites that appeal to the tech startup community of San Fransisco, though the appeal is much broader (I'm in upstate NY).

I guess it's a bit hard to explain, but there's a cluster of points of interest that appeal to the stereotypical user on hacker news, of which generative art (and potentially a "wave function collapse"-like algorithm that you may or may not be using), architecture, brutalism and indie gamedev are part of that list.

I suspected your project resonates with a lot of people's interest who frequent the site, which is why I submitted it here (anyone can submit, I just happened to be the one that did it first).

[0] https://www.ycombinator.com/

abetusk··on Tiny Brutalism
From the comments section [0]:

"""

specs:

Windows 10 / macOS 12+ / Ubuntu 22.04+ Any GPU from the last ~8 years, integrated is fine, M1 Macs are plenty 4 GB RAM ~250 MB disk

It's a small game, no dedicated graphics card needed.

"""

[0] https://placeholders.itch.io/tiny-brutalism#post-17475584

abetusk··on Sustainable energy without the hot air (2008)
I find it interesting that the average energy consumption of a person (or household?) is roughly 30kWh/day and the energy usage of a car is roughly 40kWh/day. I wonder if it's some kind of truism that our transportation needs roughly equal our energy needs.

I'd be interested to know if that's just a coincidence or whether there's an underlying reason.

abetusk··on Universe, Drawn in ASCII
code: https://github.com/eshin087/gcdatlas
abetusk··on How big are factorials?
lg(n!) grows roughly as (n lg n). Constants matter, of course, but to that's the rough estimate.

As an aside, if you take numbers from 0 to (n-1) in an array, there are n! configurations, so representing each configuration or differentiating each configuration take n lg n bits. So, in some sense, taking a mapping that's able to differentiate the input state to map to the ordered state takes at least O(n lg n) time, the standard runtime of a basic sorting algorithm.

Any additional assumptions (n larger than maximum element, distribution of elements) helps reduce this.

abetusk··on On the Navier–Stokes Millennium Prize Problem
What is the other clay prize that's might be solved now/soon?
abetusk··on A Small Telescope That Surprised Me
Do you have a repo for this project? I would encourage you to work in the open, if you're not already.

Even a BOM would be helpful. Also understanding the post-processing/cleanup step would be interesting.

abetusk··on Leveraging Sparsity to Accelerate Automatic Differentiation (2025) [video]
Video lecture discussing sparse automatic differentiation.

Blog post: https://iclr-blogposts.github.io/2025/blog/sparse-autodiff/

Previous discussion: https://news.ycombinator.com/item?id=43828423

abetusk··on HydroGym: A Reinforcement Learning Platform for Fluid Dynamics [video]
paper: https://www.nature.com/articles/s41586-026-10917-6

code: https://github.com/dynamicslab/hydrogym

abetusk··on Who Owns Commodore? The Retro PC Brand Still Exists, but a Lot Has Changed
The picture of the teenager holding a piece of paper in front of a commodore is of Regina King [0].

[0] https://www.fineartstorehouse.com/michael-ochs-archives/regi...

abetusk··on Google is making private AI practical with homomorphic encryption
1000x slowdown is bad but not a complete deal breaker. Do you have a sense of what a reasonable achievable factor is? Do you have sense for how long before we get to that achievable factor?
abetusk··on NP-overrated
> For [Dependency resolution] and [Type checking], the worst-case just doesn't occur. ... at least in my career, I've never seen a galactic blow-up.

Both of these problems have been hand crafted and sanded down so as not to get into situations where there's exponential blow up.

> [Scheduling] and [Traveling Salesman] are technically optimization problems. Everyone knows you can tackle those with heuristics, ... We absolutely have tools that can find provably optimal solutions in reasonable time. There's no magic. No quantum computers. Just thinking harder and coming up with better algorithms. ... algorithmic speedup has outpaced hardware gains in the last decades. ...

The tools that can "absolutely find optimal solutions" don't, for even toy problems. Thinking harder helps, sometimes, but barely scratches the surface of most of these problems. Most of the time, thinking harder doesn't magically solve these problems.

> Last but not least: even (5), the archetype of NP-hard problems, is routinely solved at scale.

If this were even remotely true we'd have seen substantial progress in automated theorem proving well before the last couple of years. Notice how there are many math problems succumbing to automated techniques? This isn't because SAT solvers "routinely solve this at scale", it's because LLMs are getting better.

Why do we need type checking in the first place? One reason is to help find bugs. We need to enforce type checking to reduce bugs because reducing programs to SAT to ensure they're bug free is intractable. SAT is solved at scale? Why haven't they made solvers to prove your code is bug free so you don't need type checking in the first place?

I'm not up on scheduling software or research but my bet is that people who actually write schedulers would say that those tools that "absolutely" solve the problem absolutely don't.

The post almost gets it but never quite makes the leap. Taking Turing machines, for example. It's pretty easy to show that the Halting problem is undecidable. It doesn't mean all programs can't be analyzed, it means that there's no general method that will work for all programs. We don't give up on writing programs, we restrict ourselves to programs that we can reason about.

The ensemble, the space of problems we draw from, is specifically chosen so that we can do interesting work. But even that's restrictive and we're trying to constantly push to see what other programs we can analyze that are past our current front of knowledge.

This reads like child going into a supermarket and declaring farming, logistics and food scarcity to be solved because of the abundant availability of goods on the shelf. The world we've made is specifically crafted so that normal use is smooth. The fact you can't see it means you're living in a coddled domain and haven't pushed past it.

abetusk··on A Tale of Dynamic Programming (2022)
[0]:

> ... I thought dynamic programming was a good name. It was something not even a Congressman could object to. So I used it as an umbrella for my activities.

[0] https://en.wikipedia.org/wiki/Dynamic_programming#History_of...

abetusk··on Solving the Shortest Vector Problem in $2^{0.6039n}$ Time via Mid-Point Hessian
Could someone summarize what the main idea is for this method?
abetusk··on An Interesting Fourier Transform – 1/f Noise (2007)
Power law distributions are specializations of the more general Levy stable distributions [0] [1]. Levy stable distributions answer the following question:

Given that the sum of independent and identically distributed random variables that converge to a distribution, what is the distribution they converge to?

If you answered Gaussian, you'd be wrong. The correct answer is Levy stable. There was no condition on finite variance. When variance can be infinite, Levy stable, or power law tail distributions, is the result. When the variance is finite, a Gaussian is the limiting distribution and, consequently, a Gaussian distribution is part of the family of Levy stable distributions.

The stability quality is the reason why the Levy stable (aka power law tail) distributions show up all over the place. If you've ever heard that the reason why the Normal distribution is called "normal", because the sums of (finite variance) random variables converges to a Gaussian, the same reasoning applies to the Levy stable. In some sense, Levy stable distributions are more normal than the normal distribution. My opinion is that infinite variance is hard for people to wrap their heads around, so they reject the premise.

Unfortunately I don't have a good answer for what the article brings up about the Fourier transform, but I'm almost positive that this can be answered with Levy stable distributions in mind. I will say that the distribution is often characterized by it's characteristic function. A short perusal of Wikipedia talks about Levy stable distributions being closed under Fourier transforms, which is what the article is talking about.

[0] https://en.wikipedia.org/wiki/L%C3%A9vy_distribution

[1] https://en.wikipedia.org/wiki/Stable_distribution

abetusk··on Protopia
1% compounding "positive impact", however that's defined, still leads to a singularity like event. Moore's law-like effects are doubling computing power for fixed cost at 1.5 to 2 years, so it's noticeably fast, especially as we get near the "hockey stick" point, but there are other exponential effects that are happening in tandem, notably solar.

Global energy usage is rising at a yearly rate of about 2.5%. In my view, this is one of the most basic statistics that correlates to improved quality of life.

Regardless of what measure of "progress" you use, if it's compounded, it leads to drastic changes very quickly.

abetusk··on The Entropy of a Markov Chain
I'm not sure I had a well formed question. I saw the post title, didn't get a clarification in the article and started searching.

The entropy rate seems like a pretty natural definition of "entropy of a Markov chain", no? It's not exactly this but it's similar to "start at state i, end on state j (maybe in n steps?), what is the number of bits I need to send over the wire to tell you what path was taken".

What does the entropy of the raw stationary distribution give you? Is the entropy rate related to the entropy of the stationary distribution (the thermodynamic entropy?)?

abetusk··on The Entropy of a Markov Chain
OK, no, I'm wrong. The entropy of a Markov chain with stationary distribution v is [0]:

    -\sum v_i p_{i,j} \log(p_{i,j})
That is, the "entropy" of the transition matrix modified by the stationary distribution.

[0] https://math.stackexchange.com/questions/1040972/entropy-of-...

abetusk··on The Entropy of a Markov Chain
So how does one calculate the entropy of a Markov Chain? Is it actually specified? If so, it seems buried.

The Markov chain provided as an example has the edge labels swapped (np should be qp and qp should be np). Regardless, what is the entropy of the example provided?

The problem with Markov chains is that states are dependent, so simply cataloguing states now violates the basic entropy calculation as neighboring states are now dependent on each other.

If the Markov chain is ergodic then maybe you can talk about the entropy of the stationary distribution? Then it's just $-\sum p_i lg(p_i)$ of the stationary distribution probabilities?

The article alludes to how entropy evolves. In the context of ergodic Markov chains, this is related to the size of the second eigenvalue?

abetusk··on AI's debt binge can't last, hidden borrowing reaches $1.65T
You've talked past the point. Both can be true.

It took 10-15 years before the stock market got back to the level it did pre dot-com crash [0].

[0] https://en.wikipedia.org/wiki/Dot-com_bubble

abetusk··on Cesium DevCon 2026 talks are up, including a keynote from SQLite's creator
The SQL planner is most definitely "AI", we're just so used to it that it's become trite to say so. I'm having trouble tracking down the version I heard about, but this essentially the "AI effect": "Every time we figure out how to do one of these tings, it ceases to be called AI and just becomes useful software" [0].

Part of the reason I'm dismissive of the current pushback against AI is that people have such a vague definition of it that it starts becoming all inclusive to subsume things like SQL, the Shazam algorithm, etc. Personally, I think it's a good reminder that SQL has quite a bit of intelligence in it. After all, SQL was one of the first mass successes of a declarative based engine.

Put another way, in some abstract sense, one of the differences between SQL query planning and an LLM is one of scale and compute. I wouldn't be surprised that, at some point in the future, we'll see LLM simulation in SQL(ite) akin to how people use different systems to run Doom.

[0] https://en.wikipedia.org/wiki/AI_effect

abetusk··on Cesium DevCon 2026 talks are up, including a keynote from SQLite's creator
And him receiving a lifetime achievement award here: https://www.youtube.com/watch?v=40v2JFzgEPY&t=4802s
abetusk··on Don't Take the Black Pill [video]
[0]:

> If you refrain from participating in the software of the commons, the only thing that you're doing is surrendering more of our collective agency to abusive centralized powers.

[0]: https://www.youtube.com/watch?v=zLZwpH5lCD4&t=1622s

abetusk··on What happened to TheNumbers.com
I think people are missing one of the points of the article. It's not just that agents are hammering the site, it's that there might be lurking vulnerabilities that allow malicious usage, which is why it went down, then came back up with a fraction of the data and a reduced design.

The article says (speculates?) that malicious users are trying to get privileged access for an edge in prediction market betting. From the article:

> If you could see The Numbers data before everyone else, every single week, you would have a significant edge over all the other traders - learning the answers slightly ahead of publication would allow you to front-run the trades.

abetusk··on Lobste.rs is now running on SQLite
Invitation sent. Let me know if you haven't received it.
abetusk··on Lobste.rs is now running on SQLite
Invitation sent. Let me know if you didn't get it.
abetusk··on Lobste.rs is now running on SQLite
Invitation sent. Let me know if you didn't receive it.
abetusk··on Lobste.rs is now running on SQLite
Invite sent. Let me know if you didn't get it.
abetusk··on Lobste.rs is now running on SQLite
Thanks, this is really embedded in the documentation and is not at all even hinted at in the above documentation.

This seems like a huge DoS security hole.

I encourage you to write a blog post about this. It seems especially relevant.

abetusk··on Lobste.rs is now running on SQLite
Could you go into more detail about this issue and provide some links to the documentation?

I'm absolutely no expert, I'm just reading about it now, but from the SQLite WAL documentation [0]:

> 7. There is the extra operation of checkpointing which, though automatic by default, is still something that application developers need to be mindful of.

and from their "checkpointing" documentation [1]:

> By default, SQLite does a checkpoint automatically when the WAL file reaches a threshold size of 1000 pages.

I'm only skimming but I see no mention of waiting for an idle time window.

Have you been successful in DoS'ing lobste.rs?

[0] https://sqlite.org/wal.html

[1] https://sqlite.org/wal.html#ckpt

Page 1 of 34Next →