HNHacker News
TopNewBestAskShowJobs

chucky_z

1,215 karma · joined June 16, 2015

[ my public key: https://keybase.io/chuckyz; my proof: https://keybase.io/chuckyz/sigs/TE7_P8BlEovO4suPMF-Ul1FrCWsehSIgTOp-NxZbW9g ]
submissionscomments
chucky_z··on New Amazon S3 Storage Class – Glacier Deep Archive
For backing up something personal, why don't you just use actual Backblaze?
chucky_z··on Maybe You Don't Need Kubernetes
canonical maas, ns1, aws, nomad, consul, vault, and a handful of other providers
chucky_z··on Maybe You Don't Need Kubernetes
I manage everything soup to nuts with Terraform. If you know something vastly better please let me know, especially considering the changes to 0.12. It's a very well integrated system.
chucky_z··on Maybe You Don't Need Kubernetes
I've started heavily using Nomad recently and it's a real joy. Adding things in is just so easy because it doesn't do much and (mostly) everything is very well defined. I cannot suggest it highly enough.

An example is I setup a log pipeline recently spanning multiple data centers with full mTLS. It wasn't that hard and thanks to Vault all the certs are refreshed at regular intervals all over the place. Pretty great!

chucky_z··on Tesla Model Y
it better be a track-only model
chucky_z··on Microservices, Containers and Kubernetes in Ten Minutes
AWS SAM nails this so hard.

They straight up have hundreds of pre-generated tests depending on what your functions input is, and you can run _every_ test locally.

chucky_z··on San Francisco median one bedroom apartment rent hits a new peak of $3,690
$3,689.99
chucky_z··on SQL: One of the most valuable skills
ROW_NUMBER is absolutely the best, especially for marketing related customer data.
chucky_z··on They Own the System: Amazon Rewrites Book Industry by Marching into Publishing
Alibris
chucky_z··on They Own the System: Amazon Rewrites Book Industry by Marching into Publishing
I have not bought a book from Amazon in years... I go elsewhere for books nowadays. I'm one data point, but I have a close friend who works for an online book marketplace and they're doing extremely well.
chucky_z··on Switching my parents over to Linux saved me a lot of headache and support calls
The author explicitly states why they did this.

Chrome for Netflix and Spotify only, and Office 2007 because it's better than LibreOffice for their parents.

chucky_z··on More games should be honest about death
I can suggest the recent Wolfenstein games.
chucky_z··on 911 emergency services go down across the US after CenturyLink outage
In my experience this exists for ISPs, but it's not easily available. I've used ISP brokers in the past and they've had this information in some proprietary systems when I've asked for quotes and proposals.
chucky_z··on Great Wall Motor unveils $9k electric urban car with nearly 200-mile range
The top speed is only 100kmh or so, so it's probably subject to some special rules
chucky_z··on Mac mini review–a testament to Apple’s stubbornness
If you can swallow the privacy concerns, Chromebooks/Chrometops seem to be remarkably reliable and 'just work.'

My main experience with them is in Google Hangouts through a 3rd party (Promevo), and the only troubleshooting I've had to do required a total system refresh, which the box itself found it's own OS was corrupted, re-installed from a remote source, and then after a quick 10-min setup was right back to where it was the second it broke.

I would probably not use one personally, but for family computing they seem a right treat.

chucky_z··on OpenZFS vs. Btrfs and other file systems (2017)
.... XFS?

I've had a single issue across many EBS drives partitioned with only XFS, in several mdadm configurations. The data-loss occured during a maintenance window, so I'm convinced it was an EBS issue and not XFS.

I've also used it on physical hardware and never experienced dataloss, even losing drives in RAID configurations (I will admit I was lucky enough to never lose 2 drives in my normal RAID10 setup).

I've had several filesystems become corrupted, but the XFS community is extremely helpful, and the tooling that comes with it has never failed me in at least letting me figure out what's actually wrong.

chucky_z··on PipelineDB 1.0 – High-Performance Time-Series Aggregation for PostgreSQL
I've been following Pipeline since the beginning and it's so fricking cool. Please, if you can't think of a good use of Pipeline, use it instead of a count(*)! :D
chucky_z··on Terraform Collaboration for Everyone
I used TF very early on, for versions 0.3 and 0.4. It was unpleasant at best, but very functional.

I've began using it again with 0.11, and with 0.12 on the horizon it's much easier to use than it ever has been in the past. It used to be very difficult to do one-off tasks with Terraform but I've began managing things piecemeal and the community around importing everything into existing TF things are great.

The statefile borking itself from time to time is still an issue, but no more than any other operational tool of this magnitude.

The biggest downside to Terraform currently (0.11) is that you need to get extremely creative in ugly ways to accomplish some tasks. This can been seen very specifically in the AWS Security Group official TF module, which I could not live without, but would not want to write/maintain.

chucky_z··on PostgreSQL 11 Released
Actually an interesting solution to this is using something like kafka-connect. Debezium specifically has libraries around pgsql -> pgsql replication using kafka + kafka-connect that work shockingly well. The lag is not much different than traditional replication but you can have a single primary that kafka-connect is pulling into kafka, and a gazillion replicas off that single stream.
chucky_z··on Running a database on EC2? Your clock could be slowing you down
That's super bizarre. Are you running MySQL with no ACID on EC2 while leaving RDS at its defaults or something?
chucky_z··on Running a database on EC2? Your clock could be slowing you down
You can replicate out of RDS without any problems. Shoot, you can run a master in EC2 and a replica-only in RDS.

I do this presently because I have some custom stuff I do for MySQL which needs it's own EC2 instance because RDS doesn't support it.

chucky_z··on Brave files adtech complaint against Google
Not quite identical, but you mostly just described mastodon.

https://joinmastodon.org/

chucky_z··on How I slashed a SQL query's runtime with two Unix commands
This is also an older benchmark. I'd be curious to see this used against postgresql 11; there have been massive speed increases in 10 and now 11.

One of the most interesting things is you can shard postgres extremely easily now by using FDWs which can do native pushdown of optimizations.

Also, Citus itself has been improving in that time, and I'm curious to see how that performs.

chucky_z··on Show HN: Owl, a new kind of parser generator
Is Owl similar to ANTLR? Could you explain the differences between the two languages, and what makes a parser unique if they're similar?

I'm curious because I've quickly run across two of these types of projects now, but admittedly know very little about them.

chucky_z··on Jenkins pipelines as YAML
Have you looked into https://wiki.jenkins.io/display/JENKINS/Groovy+Hook+Script ?

There's a handful of cool scripts that other folks have written :)

Check out this repo for an example: https://github.com/hayderimran7/useful-jenkins-groovy-init-s...

chucky_z··on Nagini: A Static Verifier for Python [pdf]
The reasoning why this exists is in the very first paragraph...

> Python’s lack of safety guarantees can be problematic when, as is increasingly the case, it is used for critical applications with high correctness demands. The Python community has reacted to this trend by integrating type annotations and optional static type checking into the language [20]. However, there is currently virtually no tool support for reasoning about Python programs beyond type safety.

chucky_z··on Apple to deploy 1Password to all 100,000 employees, acquisition talks underway
1Password is amazing. Hopefully Apple doesn't even touch them, and they continue developing that CLI that's been hinted at and teased a few times.
chucky_z··on Cloud Filestore, high-performance file storage for GCP users
Unrelated to EFS, but I found Gluster to have good performance for this use-case vs. NFS/CIFS.
chucky_z··on Cloud Filestore, high-performance file storage for GCP users
We use ~100GB with a lot of in/out for EFS, as a kind of 'nearline S3,' mounted to a hundred ec2 instances or so. It replaced an NFS server doing the same thing, and it ended up being slightly cheaper cause you don't pay for the compute, only the storage (efs vs. ebs + ec2).

Also I haven't had a single issue with performance. It's not particularly busy though (~800 iops?).

chucky_z··on Gracefully Scaling to 10k PostgreSQL Connections for $35/mo, Part Two
I'm glad that pretty much the whole thing is 'use pgbouncer.'

This was my exact situation at a previous position. We needed up to 20k connections to a single pgsql master. Even the most monster postgres server falls over around ~600 connections (up to 1k depending on usage).

Using a pgbouncer-per-webserver we easily got to 20k.

I will say this was with 9.3 though, things may have changed on that front. Nowadays I use pgsql primarily for analytics, so there's only ever 20-30 connections tops, albeit doing quite heavy querying.

← PreviousPage 11 of 16Next →