I thought AWS was dropping the ball on Open Table Formats, but this one is a smart move and a direct shot fired at Databricks with Delta.
Simply by making it the default for software engineers wanting a big data table on S3
9 karma · joined September 28, 2023
I thought AWS was dropping the ball on Open Table Formats, but this one is a smart move and a direct shot fired at Databricks with Delta.
Simply by making it the default for software engineers wanting a big data table on S3
With tools like this providing a comprehensive python API and the ability to always fall back to raw SQL, i am not sure DuckDB devs should focus on the python API at all beyond basic (to_table, from_table) features.
Impressive progress and a real chance to shake up the data tool market, but still a way to go: There is is still much to do especially on large table formats (iceberg/delta) and memory management when running on bigger boxes on cloud. Eg the elusive "Failed to allocate ..." bug[1] is an inhibitor to the claim that big data is dead[2]. As it is, we tried and abandoned DuckDB as a cheaper replacement for some databricks batch jobs.
[0] https://github.com/ibis-project/ibis [1] https://github.com/duckdb/duckdb/issues/12667, https://github.com/duckdb/duckdb/issues/9880, https://github.com/duckdb/duckdb/issues/12528 [2] https://motherduck.com/blog/big-data-is-dead/
DuckDB also has potential for IoT/embedded use cases as a data buffer with its compression and efficient reads, instead of just sqlite. but for that it needs to free up disk after expiring data
For instance, musicians one really likes, one projects them into images of saints. Then they're out their putting selfies on, sharing insipid quotes or just generally seeking validation, and the mirage crumbles a bit.
First of all, the unnecessary mention of "mostly white male". I'm So. Bloody. Tired of this trope being injected into every article at every opportunity. I get it. Life unfair. Move on. It's like how every NYT comment section will mention Trump within the first two comments. Give it a rest already!
Then, the vague-at-best connections between minimal art and Minimalism as a response to the excesses of Boomers. It's really not that complicated. Grow up in a house of hoarders, and you're well on your way to embracing minimalism.
Lastly, this whole "Your bedroom might be cleaner, but the world stays bad". Yeah! Minimalism doesn't promise world peace! It's just a way to make your own life more manageable and sane!
Just because a piece is longform doesn't mean it's good. Reading this article was a terrible waste of my time.
Fine, but where are the people who will spend ten minutes talking about the different keyboard options they considered for their daily driver? Where are the people who have to read code for a living and will openly mock 16:9 with it's pathetic vertical space? Talking about how easy it is to dual boot Linux on the machine?
If anyone knows of such reviewers, please drop a link below. I'm sick of wathching MKBHD.
Actually, I'm Indian, and we have our steering wheel on the right side, just like the Brits. It's one of the less fortunate things we picked up from them.
I've a particular hatred of Fahrenheit :)
Utterly hopeless.
But to your main point, I've seen my share of the polite leading the polite. If there is a general level of competence, fine, work can still proceed. But often, workplaces need an asshole who will voice their opinion in blunt language. There are moments when diplomacy causes, at best, avoidable delays, but at worst completely fucked projects.
Totally agree about the no humour thing on HN though.
The Reddit of today is about posting the "funniest" screenshots from Twitter, things like blackpeopletwitter, whitepeopletwitter, murderedbywords and so on.
Much as I rail against the overly pedantic nature of many, many comments here, this place is a veritable treasure trove compared to Reddit.
On Reddit, every single fucking thread gets derailed by shitty puns, basement-tier humour or a one-liner with all the nuance of a tweet. Doesn't matter how sombre a topic, some dickhead is going to make an oh-so-clever quip and legions of fellow dickheads will line up to suck his dick and upvote it to the top.
Even when there are substantive comments, the replies to those comments rarely make for useful reading.
"Take my upvote and fuck off"
"Nice"
"Mom's spaghetti"
"/r/Suicidebywords" on a comment about dick sizes
... and on and on
Not to mention the fact that Reddit's recent algorithms upvote the shittiest content to the front page to begin with. I mean, /r/dankmemes? /r/memeeconomy? /r/wholesome memes? Fuck outta here with that shit.
There are exceptions, of course. /r/financialindependence comes to mind. But overall, it's become an out of control shitshow that I visit ever less frequently.
So yeah, thank god for HN.
I had a twinge of hope that this might have been more of an introduction to using the terminal effectively on Linux for diagnoses.
I'm new to Linux, and every time I have an issue and find a thread addressing it, they ask for me to run a whole bunch of commands and paste a bunch of logs. I'm happy to do that, don't get me wrong, but I rarely have the faintest idea of what it is that I'm typing in.
I'm genuinely curious why you chose this route.
Also, sorry to invoke the slippery slope argument, but otherwise what's stopping us from devolving all the way back to scriptura continua?
I will counter by saying that, functionally, there is little difference. What is at stake is our means of feeding ourselves. Our means of getting enough drinking water for all of us. For some stability and order and for their not to be anarchy. For having the remotest signs of biodiversity around.
If, a thousand years hence, there are still humans around, who gives a shit. Because what will have been lost is so grave in magnitude, and so unnecessary, that it would be a shame to even call it life.
The reason for this storm in a teacup is that useful posts such as this one get derailed by fruitless discussions about the words themselves or arguing about things that don't matter.
At any rate, my take is that it's an excellent move by the Guardian, and I hope NYT also follows suit and starts calling it climate crisis. Our challenges are SO huge that it's difficult to be hyperbolic enough at all. EVERY single biomarker that you can think of is off the chart perilously.
We are wreaking absolute havoc on every single system critical in supporting life, and it I'm all for terming it in as alarmist a tone as necessary.