HNHacker News
TopNewBestAskShowJobs

calpaterson

4,910 karma · joined May 6, 2008

meet.hn/city/fi-Helsinki

Socials: - github.com/calpaterson

---

https://calpaterson.com

cal - AT - calpaterson - DOT - com

submissionscomments
calpaterson··on S3 is files, but not a filesystem
Thanks. I take your point on the first one and have corrected it (maybe you need to shift+F5 to bust your cache in order to see it).

For the second one, what's your objection? That it's fragmentary?

calpaterson··on Snowflake, the Missing Primer
Sorry - this was an early draft of a future post that somehow was submitted here. I've removed it now, thanks for proofreading :)
calpaterson··on Snowflake, the Missing Primer
Sorry - this was a draft that I published accidentally while fixing a typo in another article and which someone apparently submitted it here before I could take it down.

It should 404 now. Perhaps next week :)

calpaterson··on S3 is files, but not a filesystem
Author here, I can't reply to the GP because that comment is "dead" but yes, please, be specific!

Then I can fix the sentences that are bad and perhaps also improve in the future.

calpaterson··on S3 is files, but not a filesystem
I have to say that I'm not hugely convinced. I don't really think that being able to pull out the keys before or after a prefix is particularly impressive. That is the basis for database indices going back to the 1970s after all.

Perhaps the use-cases you're talking about are very different from mine. That's possible of course.

But for me, often the slow speed of listing the bucket gets in the way. Your bucket doesn't have to get very big before listing the keys takes longer than reading them. I seem to remember that listing operations ran at sub-1mbps, but admittedly I don't have a big bucket handy right now to test that.

calpaterson··on EU coal and gas collapse as wind and solar ascend
He is considered to be aligned with the Putin regime:

https://www.spectator.co.uk/article/sanction-gerhard-schr-de...

calpaterson··on EU coal and gas collapse as wind and solar ascend
I don't agree that the "vast majority" of government motivations for green energy are "geostrategic". Some of it is but much is clearly driven by genuine concern about the environment by elected representatives.

If Germany were most motivated by energy independence they would not have closed so many nuclear power plants. There are in fact lots of decisions that politicians make that are inconsistent with aiming for strategic benefits but are consistent with an earnest (and sometimes quixotic) concern for the environment. If the UK was so bent on energy independence we would have made more progress on heat pumps. Yet gas boilers (lifespan: 15 years) are still being fitted today. In truth, governments thing about energy security a bit, they think about green stuff a bit and they aren't always very effective agents of change...

I also think you're not right to imply that energy production largely happens as a result of government direction. In fact, energy prices are high at the moment and the prospect of profit drives development of green energy a great deal (not that subsidies don't have an effect as well).

To be honest (and I hope I'm not straying into a personal attack here - that's not intended) I think your viewpoint sounds clever because it is cynical. Cynical views - especially the attribution of an ulterior motive - usually sound clever. But I think your post is at best partly right and perhaps even mostly wrong. Political realism is a drug to take only in small doses.

calpaterson··on How a software glitch at the UK Post Office ruined lives
Indeed. And it was a number of different bugs, not just one.
calpaterson··on How to Choose Cookware (2014)
Non-stick pans are massively overrated. For starters most foods don't stick much - it's mostly eggs that are a problem - and only then if your pan isn't preheated.

For that small benefit, non-stick pans have become almost the default. They last a couple of years depending on care which means that your cookware is now a consumable as well was difficult to recycle. A decent stainless steel pan costs about twice what a decent non-stick does and lasts forever. It can also go in the dishwasher and works on every hob type. The best basic advice for the majority of people to make regarding cookware is: get stainless steel except for when frying eggs.

The advice in TFA is sort of similar but a lot longer. To be honest I think it could have omitted all the "$1000 budget" stuff - the people who want to buy copper/carbon steel aren't doing so based on a starter guide.

calpaterson··on How to be a sovereign email user? "you can't, we don't know how to do it."
I don't know how much sense it makes to be "sovereign" in a system designed around interaction with others but if it helps, my maildir is held on a disk I control and no one else is scanning it for marketing insights.
calpaterson··on How to be a sovereign email user? "you can't, we don't know how to do it."
I am, literally, running my own mail server. telnet port 25 on mail.calpaterson.com if you don't believe me.

Relaying is a central feature of email infrastructure and it isn't somehow cheating to relay outgoing mail to someone else rather than send it directly.

calpaterson··on Ask HN: Anyone using or have opinions on "enterprise" job schedulers?
Very unfortunately, I have mainly seen Jenkins used for this. There must be something better out there.
calpaterson··on How to be a sovereign email user? "you can't, we don't know how to do it."
I run my own mail server and recently started relaying outgoing emails to Amazon SES for delivery.

I had to get approved but they charge nothing for my usage level and it solved some of my (minor) delivery issues.

I recommend anyone running their own mail server look at it.

calpaterson··on Berkshire Hathaway posts a 40% jump in operating earnings, cash pile of $157B
> Is there a stated reason that a handful of the biggest companies are sitting on cash piles greater than the yearly GDP of mid sized nations?

The stated reason from Berkshire is that the management thinks that there are too few investment opportunities priced (far enough) below their value to be worth buying. Presumably though he thinks Berkshire stock is an exception though - and priced too low - else it would be reasonable to buy some of that back.

calpaterson··on Bandcamp's Entire Union Bargaining Team Was Laid Off
They weren't a company-specific union but a branch of OPEIU which looks like a general union for what letting agents call "professionals". To translate what I think was happening into British parlance: they were trying to negotiate employer recognition plus a collective bargaining arrangement.

I don't know if their leadership was good or not but American trades unionism is pretty different to ours. Employees typically don't have a huge amount of legal rights and so getting your workplace unionised is much more of a battle than here. On the other hand, America has de facto closed shops which are illegal pretty much everywhere in Europe.

calpaterson··on Man convicted after mother of bike theft victim holds protest outside his house
They are hugely overrated. Most people nicking bikes use angle grinders and to an angle grinder all locks are the same: less than 30 seconds of cutting.

https://calpaterson.com/bicycle-threat-model.html

calpaterson··on My favourite API is a zipfile on the European Central Bank's website
csvbase does ship parquet!

Just add ".parquet" - eg https://csvbase.com/meripaterson/stock-exchanges.parquet

calpaterson··on My favourite API is a zipfile on the European Central Bank's website
I do also use Python (pandas) partway down the page :) I'm just trying to show different tools to give people ideas about how much is possible with stuff that is already in /usr/bin/

If you were to ask my own tool preferences which I use for $DAYJOB: pandas for data cleaning and small data because I think that dataframes are genuinely a good API. I use SQL for larger datasets and I am not keen on matplotlib but still use it for graphs I have to show to other people.

calpaterson··on My favourite API is a zipfile on the European Central Bank's website
> working ETag/If-Modified-Since support

I completely agree and csvbase already implements this (so does curl btw), try:

    curl --etag-compare stock-exchanges-etag.txt --etag-save stock-exchanges-etag.txt https://csvbase.com/meripaterson/stock-exchanges.parquet -O
calpaterson··on My favourite API is a zipfile on the European Central Bank's website
Absolutely! I have a plan for a client lib that uses ETags (+ other tricks) to do just that.

Very WIP but check out my current "research quality" code here: https://pypi.org/project/csvbase-client/

calpaterson··on My favourite API is a zipfile on the European Central Bank's website
This is odd, I did originally have that argument but I removed it because it didn't seem to matter - it works without ("On My Machine"(tm))

Erk - readding it and busting the cache. After I put my kids to bed I will figure out what is wrong

EDIT: the reason it works for me is because I've got this config in ~/.sqliterc:

    .separator ','
Apparently at some point in the past I realised that I mostly insert csv files into it and set that default.
calpaterson··on CT scans of coffee-making equipment
Are there any advantages to the aluminium version of a moka pot aside from tradition/aesthetics?

I switched to one of the (Bialetti-made) stainless steel ones ("Venus" shape) because at one point I lived somewhere with an induction hob. I immaculately saw that the stainless version was considerably easier to clean. Cleaning, afterall, is half the job of using one of these.

Visually, I prefer the aluminium shape of course, but they are a real nightmare to keep clean and presumably you're drinking a lot of that aluminium oxide.

calpaterson··on I didn't write any JavaScript, and other shortcuts
> really what they do is _lean into_ and extend what's already there.

There are already so many features implemented in unix/the web/python/etc that it's easiest just to go along with what is there. For example, csvbase logs to the systemd journal (when run under systemd - stderr otherwise):

https://github.com/calpaterson/csvbase/blob/c1523615f10bbaa7...

One under recognised thing about systemd is that it provides a mini-ELK stack - so now I have indexed, searchable logs that auto-rotate and whatever (the defaults are quite good). I realise a lot of people strongly dislike systemd but I think this is a very nice feature for running services of this scale.

One more shortcut: the backend for the blog is a csvbase table. The "4" in the url here is a csvbase_row_id :)

calpaterson··on I didn't write any JavaScript, and other shortcuts
I sympathise, but what can I do? These things call themselves "frameworks":

> Get started with Bootstrap, the world’s most popular framework for building [...]

https://getbootstrap.com/docs/5.0/getting-started/introducti...

calpaterson··on All of the vehicle license plates available in America
One in five continue to drive:

https://www.thisismoney.co.uk/money/cars/article-10304829/Mo...

calpaterson··on All of the vehicle license plates available in America
I don't know about America but in the UK people don't get their driving licence taken away that often, even if they have hit 12 points (ie: racked up enough offences to theoretically lose it). There is a lot of consideration as to whether removing the driving licence will cause hardship and defendants obviously usually argue that it will (with some truth) so judges sometimes don't remove the licence.

Anecdotally, I feel like it's actually gotten less common over the years. When I was a teenager I would meet adults who were riding the bus because they'd had their licence taken away. Often it would be for a 6 month period before they could re-apply (without retaking the test). That became less frequent at some point.

calpaterson··on Dude,Where's My Donations? Wikimedia gives another $1M to non-Wikimedia projects
I am not sure it does - wikipedia famously does not pay contributors (except for that one guy). The majority of their spending is on wages though, for their 700 employees. I'm sure some of them are doing worthwhile development on MediaWiki etc but I suspect the majority are not. Like Mozilla, the organisation could charitably be described as bloated.
calpaterson··on London Then and Now: Aerial Shots Show City Grow over Past Two Decades
The answer is that London has grown (much) faster than new homes have been built.

Net migration to the UK has been about 250k per year (with some variance) since 2000. I remember reading somewhere that 2/3 of that was to London.

So you'd need to add hundreds of thousands of homes per year just to break even. Instead much less than 100k are built, usually under 40k.

There's other reasons for the price and rent rises but this is one of the big ones.

calpaterson··on More Than 40% of Japanese Women May Never Have Children
Why though? I've never been able to understand what it is that makes Japanese people so reluctant to form families and have children

EDIT: you can read the full article here: https://www.bnnbloomberg.ca/more-than-40-of-japanese-women-m... but it does not explain further.

calpaterson··on Submarine missing near Titanic used a $30 Logitech gamepad for steering
> I mean the xbox and Playstation controllers are both actually really good, sturdy, reliable controllers

In point of fact they are not. The PS5 controller has poor battery life and both have stick drift issues because they use cheap analogue sensors. The current generation of Nintendo controllers are similar: stick drift and battery issues are common. And then there are issues with wireless interference which can be a serious problem and, when it is, difficult to diagnose and fix. I don't think the Logitech controller in question even has wired as an option though of course I have no idea if that's relevant to the incident at all.

← PreviousPage 4 of 31Next →