HNHacker News
TopNewBestAskShowJobs

andrewprock

543 karma · joined November 13, 2014

Cleaning up, migrating, and rebuilding a legacy systems for over 10 years.

Integrating with AI and machine learning for over 20 years.

Need help with either of those sticky problems, send me an email.

email: andrewcprock [at] gmail.com

submissionscomments
andrewprock··on Entities enabling scientific fraud at scale (2025)
Suggesting that people would stop reading Nature if they also included replication studies send like an incredible leap.
andrewprock··on Lessons from 14 years at Google
On the contrary, the best products are typically built by the users of the products. If you are building a product you don't use, it will be worse than if you used it.

Users should be everywhere, in and out of engineering.

andrewprock··on Lessons from 14 years at Google
There are many leaders that use information as a tool that serves their own needs.

They may have the context, but they are either too focused on their own job to share it, or actively manage dissemination so they can manipulate the organization.

In my experience, this is the typical operating mode, though I do not think it is sinister or malicious - just natural.

andrewprock··on Why Twilio Segment moved from microservices back to a monolith
The whole point of micro-services is to manage dependencies independently across service boundaries, using the API as the contract, not the internal libraries.

Then you can implement a service in Java, Python, Rust, C++, etc, and it doesn't matter.

Coupling your postgres db to your elasticsearch cluster via a hard library dependency impossibly heavy. The same insight applies to your bespoke services.

andrewprock··on Kelly Can't Fail
In practice, there are a number of factors which make using Kelly more difficult than in toy examples.

What is your bankroll? Cash on hand? Total net worth? Liquid net work? Future earned income?

Depending on the size of your bankroll, a number of factors come in to play. For example, if your bankroll is $100 and you lose it all it's typically not a big deal. If you have a $1 million bankroll, then you are likely more adverse to risking it.

What is the expected value? Is it known? Is it stationary? Is the game honest?

Depending on the statistical profile of your expected value, you are going to have to make significant adjustments to how you approach bet sizing. In domains where you can only estimate your EV, and which are rife with cheats (e.g. poker), you need to size your wagers under significant uncertainty.

What bet sizes are available?

In practice, you won't have a continuous range of bet sizes you can make. You will typically have discrete bet sizes within a fixed range, say $5-$500 in increments of $5 or $25. If your bankroll falls to low you will be shut out of the game. If your bankroll gets too high, you will no longer be able to maximize your returns.

At the end of the day, professional gamblers are often wagering at half-kelly, or even at quarter-kelly, due in large part to all these complexities and others.

andrewprock··on The two factions of C++
Run valgrind on any large successful code base and you will find tons of memory corruption. It just happens to occur in places where it does not matter.
andrewprock··on Ubuntu Hoping to Remove Qt 5 Before Ubuntu 26.04 LTS
Decades? Really? The UX was so bad in 1998 I just went back to windows for another decade.
andrewprock··on Panic at the Job Market
He lost me when he boldly declared that correlation IS causation based on one chart.

Complex systems are a lot more .. um .. complex than he suggests

andrewprock··on California Approves Waymo Expansion to Los Angeles and SF Peninsula [pdf]
If you pay a lot for parking or don't use the car much this tracks. But if you have the volume, then owning a car is cheaper.

An affordable mid size car costs roughly $6k per year total cost for a new car, and about 2/3 that for a used car.

If you commute daily to work, that is 500 trips per year. Two weekend trips adds another 100 per year. Now we are talking about ~$10/trip if you own your car.

When you add the premium value you get from flexibility, then it's an even better deal. If you only drive 50x a year then yeah, just use services.

andrewprock··on All code is technical debt
And all code is an asset. Have we just reduced the conversation to: everything has a cost, and everything has a benefit?
andrewprock··on Gemini AI
The prompts were also likely different:

video: "Is this the right order?"

blog post: "Is this the right order? Consider the distance from the sun and explain your reasoning."

https://developers.googleblog.com/2023/12/how-its-made-gemin...

andrewprock··on Gemini AI
You can see the cracks in the feature early on:

"What do you think I'm doing? Hint: it's a game."

Anyone with as much "knowledge" as Gemini aught to know it's roshambo.

"Is this the right order? Consider the distance from the sun and explain your reasoning."

Full prompt elided from the video.

andrewprock··on Gemini AI
i.e. artifice-ial
andrewprock··on Gemini AI
This does highlight the gap between SOTA and business production. Google search is very often a low quality, even user hostile experience. If Google has all this fantastic technology, but when the rubber hits the road they have no constructive (business supporting) use cases for their search interface, we are a ways away from getting something broadly useful.

It will be interesting to see how this percolates through the existing systems.

andrewprock··on Ancient Echoes
There's not much to elaborate, tons of practical use cases for search, sort and storage rely on alphabetization. If you move through an analog world of organized data, you'll find and develop many practical approaches to interacting with data based on knowing the key and the alphabetic ordering. Whether it's a phone book, a map, a dictionary, or filing systems, alphabets were always used as an indexing mechanism.
andrewprock··on Ancient Echoes
It saddens me to think that alphabetization is going the way of the dodo. It was a gateway drug into computer science for me.
andrewprock··on After OpenAI's blowup, it seems pretty clear that 'AI safety' isn't a real thing
It might be better to ask the inverse. Which "AI Safety" experts are worth listening too. I have found very few, and the ones that I've found worth listening to are much more concerned about practical issues that impact systems today, as opposed to the ones that are just author fiction.
andrewprock··on After OpenAI's blowup, it seems pretty clear that 'AI safety' isn't a real thing
The crazier thing is that most advocates of "AI safety" don't know anything about "AI safety". By and large the term is marketing with very little objective scientific development.

It is essentially a series of op-ed pieces from vested interests masquerading as a legitimate field of inquiry

andrewprock··on The big TDD misunderstanding (2022)
You should be very skeptical of anyone that claims they have 100% test coverage.

Only under very rare circumstances is 100% test coverage is even possible, let alone done. Typically when people say coverage they mean "code line coverage", as opposed to the more useful "code path coverage". Since it's combinatorially expensive to enumerate all possible code paths, you rarely see 100% code path coverage in a production system. You might see it for testing vary narrow ADTs, for example; booleans or floats. But you'll almost never see it for black boxes which take more than one simply defined input doing cheap work.

andrewprock··on datetime.utcnow() is now deprecated
Deprecation should not break anything. At some point the code will be removed and the org will have to pin the version until the deprecations are resolved.
andrewprock··on ELTP: Extending ELT for Modern AI and Analytics
I do like how the end to end pipeline is captured with ELTP. Conceptually I find it lighter than: ETL + Reverse ETL. While I might personally find modular ETL to be even lighter, that moniker is particular to myself and I wouldn't ask anyone else to take it up.

Regarding control, that's something I've never felt with production data. It's such a wild beast. Once the data leaves your team/code, all bets are off.

andrewprock··on ELTP: Extending ELT for Modern AI and Analytics
It's cleaner to say that ELTP is really just two ETL steps done in sequence.

ETL1: gather the raw data from the data source, mapping it to the schema required to load it into the data store.

ETL2: pull the normalized data, process it in some way, and load into a downstream data store.

I suppose that ETL is typically bound to getting data into a warehouse, but that feels like a largely arbitrary distinction. We are just moving data from source to sink.

andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
Ten years ago Apple was by far the highest quality laptop manufacturer. There was essentially no other option back in the early 2010s. Even now laptops with a "retina" display are not always easy to find for other manufacturers. In retrospect, that was probably the killer feature which induced me to switch.
andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
Not really. The difference in build quality was night and day; metal vs. plastic, keyboard that doesn't flex, etc.
andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
No, it was around $1100 IIRC, maybe as much as $1300.
andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
I used buy a $700 Windows laptop every 18 months in the 2000s. Then I got fed up with them just falling apart and switched to Macbooks. My 2013 purchase is still alive and being used by the kids.
andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
The honest reason is that there is no practical reason to upgrade. The computer works, and despite the various FUD you might read, the attack surface for external attacks is quite small for personal computers.

That said, if anyone would like to send me $4000, I will absolutely upgrade to a new 14" Macbook in a heartbeat.

andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
I assure you, I take security quite seriously. The version of MacOS I'm using is nowhere near the top security risk.
andrewprock··on Apple unveils M3, M3 Pro, and M3 Max
I'm still using a 2015 macbook for my personal daily driver. I have to plug it in regularly, but otherwise it works just fine for everything except video editing.
andrewprock··on Why teachers in South Korea are scared of their pupils, and their parents
The power of education has nothing to do with the teachers. It has to do with hiring for professional employment with degree requirements (e.g. management, government, lab techs, etc). There are tons of people who can do various jobs but do not have the required (often extraneous) certification. Parents are not chasing learning, they are chasing certification. Those two things correlate, but not enough to satisfy parents.

A good example of this is journalism, which used to require little to no certification, but which today can require masters degrees for some positions.

In the end, the people that know and learn will have longer more productive careers, but there are enough sinecures in Korean (and US) society that the value of certification is overweighted.

Page 1 of 20Next →