HNHacker News
TopNewBestAskShowJobs

rustyconover

365 karma · joined May 5, 2014

https://www.linkedin.com/in/rusty-conover-ba5a6/
submissionscomments
rustyconover··on AWS Acquires DuckDB
I'll kick it off again for you.
rustyconover··on AWS Acquires DuckDB
In 2.0 you can sign extensions with your own key and have your own extension repo. Thats the plan at least.

In 1.5 - Haybarn has its own signing key, but its much faster to get extensions released and deployed.

rustyconover··on AWS Acquires DuckDB
You can get in touch with me, or open an issue or PR as to why.

The CI extension build runs are still public on GitHub, but may have expired, if you bump your git sha ref it will rerun.

rustyconover··on AWS Acquires DuckLabs
If you need a fork, I've already done most of the hard work for all of you.

https://query.farm/haybarn/

Or

https://github.com/Query-farm-haybarn

I've been releasing the versions all the way since 1.5.3 and all community extensions.

rustyconover··on AWS Acquires DuckLabs
I've already created Haybarn which is Query.Farm's distribution of DuckDB:

learn about it here: https://query.farm/haybarn/

rustyconover··on Why Large Language Models Fail at Tabular Prediction
Look at the white text on white background in Appendix F. Pretty funny.
rustyconover··on ggsql: A Grammar of Graphics for SQL
With the new PEG parser this is just a Claude session away in DuckDB.
rustyconover··on Fair Weather
Determine and schedule the best windows of your day for running and walking.
rustyconover··on Why DuckDB is my first choice for data processing
DuckDB is awesome and Robin is too!
rustyconover··on Show HN: DuckDB for Kafka Stream Processing
The next major release of Tributary will support Avro, Protobuf and JSON along with the Schema Registry it will also bring the ability to write to Kafka with transactions.

But really you should get excited for DuckDB Labs to build out materialized views. Materialized views where you can ingest more streaming data to update aggregates. This way you could just keep pushing rows through aggregates from Kafka.

It is going to be a POWER HOUSE for streaming analytics.

Contact DuckDB Labs if you want to sponsor the work on materialized views: https://duckdb.org/roadmap

rustyconover··on WebTransport is almost here to allow UDP-like exchange in the browser
Where are the server side implementations?
rustyconover··on Karpathy on DeepSeek-OCR paper: Are pixels better inputs to LLMs than text?
Yet again Hollywood is prescient. This post reminds me of the language of the aliens in Arrival. It seems like the OP would see that as a reasonable input to an LLM.
rustyconover··on Show HN: Duck-UI – Browser-Based SQL IDE for DuckDB
Thanks for building this!

Using my textplot extension doesn't result in my expected output:

---

install textplot from community;

load textplot;

select tp_bar(0.5)

---

rustyconover··on Show HN: Duck-UI – Browser-Based SQL IDE for DuckDB
There are so many!

Rill Data - https://www.rilldata.com Summer - https://summer.io Hex - https://hex.tech Evidence - https://evidence.dev

rustyconover··on America is now one big bet on AI
Just remember TINA - "There Is No Alternative."

But come on, there should be an alternative.

Without diversification, we’re just setting ourselves up for an economic rug pull the moment the AI growth hits the law of large numbers and people realize its not the magic they think it is. Economically? Don’t worry it’ll just be another “oops, your 401k lost a bit, here’s a bailout” moment. AKA, stimulus with sprinkles.

So yeah... keep buying those dips girls and boys.

rustyconover··on Return of wolves to Yellowstone has led to a surge in aspen trees
Yellowstone is a national park, you can’t hunt anything inside the park’s boundaries. Wolves can.
rustyconover··on Return of wolves to Yellowstone has led to a surge in aspen trees
I'm not a biologist, but I grew up in West Yellowstone around the time wolves were reintroduced. Their return—and its impact—has been extensively studied by experts far more qualified than me.

That said, I believe wolves had a profound effect on the Yellowstone ecosystem, particularly on elk and deer populations. Before their reintroduction, those species had few natural predators beyond hunters, vehicles, bears, and the occasional mountain lion. The imbalance led to overgrazing and the spread of diseases like Chronic Wasting Disease (CWD) in elk.

rustyconover··on Airport for DuckDB
Thanks for taking the time to understand the philosophy of the extension.
rustyconover··on Airport for DuckDB
Only the data source.
rustyconover··on Airport for DuckDB
Thanks for the compliments!
rustyconover··on Airport for DuckDB
That’s possible with the arrow extension today.
rustyconover··on Bauplan – Git-for-data pipelines on object storage
I'd love to see a 10 minute YouTube video of the capabilities of this product.
rustyconover··on Ada crate of the year 2024 announced
Ada was the first language they threw at us in university back in '98. At the time, it felt like learning Latin to become a poet, but looking back, those lessons—rigor, clarity, and discipline—have aged better than some modern frameworks. Ada may not trend on GitHub, but it quietly shaped a generation of better programmers.
rustyconover··on Adding concurrent read/write to DuckDB with Arrow Flight
This is a great lead up to my talk at DuckCon 6 on Friday in Amsterdam.

It’s title is: “Airport for DuckDB: Letting DuckDB take Apache Arrow Flights”

You can stream it at: https://duckdb.org/events/2025/01/31/duckcon6/

You’ll see how DuckDB can integrate with Arrow Flight for reading/writing/creating tables, scalar user defined functions, table returning functions, table in/out streaming functions, row/column filtering and anything else I can breeze through in 15 minutes.

It all starts with a single call to ATTACH with the URL of the Arrow Flight server.

rustyconover··on DuckDB Community Extensions
As the author I'm happy to answer any questions. I'm glad you like the idea of the extension.
rustyconover··on Databricks Buys Tabular (The Iceberg Company)
| We are excited to announce that we have agreed to acquire Tabular, Inc, a data management company founded by Ryan Blue, Daniel Weeks, and Jason Reid. This acquisition brings the original creators of Apache Iceberg™ and those of Linux Foundation Delta Lake, the two leading open source lakehouse formats, together.

DataBricks has bought out Tabular which gives them more influence over Iceberg's future path.

rustyconover··on Cargo thefts spiked 68% in Q4, led by food and beverage freight
Percentages without a scale of the absolute value aren’t that easy to interpret.

Sure, you’re telling me the slope is steep compared to being flat, but is it the side of an ant hill or the Himalayan mountains? Both can be very steep, relatively.

rustyconover··on Pack: A new container format for compressed files
If you're looking for a debate against ZStandard, its hard to argue against it.

ZStandard is Pareto optimal.

For the argument why, I really recommend this investigation.

https://insanity.industries/post/pareto-optimal-compression/

rustyconover··on Regent – Electric coastal travel
What if a slow moving sailboat came across this plane’s path? If it is using ground effect it couldn’t climb much.
rustyconover··on Is Facebook's “Prophet” the time-series Messiah or just a naughty boy?
Prophet is not my favorite time series forecasting package. I agree with the author’s findings.

Microprediction.com (the site that wrote this article) is a great place to win monthly cash prizes for actually providing forecast accuracy, the twist is you have to provide your forecast as a sample of 225 points from a forecast distribution rather than just providing a point forecast. This makes participation “interesting”.

Also to win you have to be more accurate than everything and everyone else that is providing predictions.

Page 1 of 4Next →