16,407 karma · joined January 19, 2011
There was discussion yesterday [0] that pointed out that there are 29MB Debian [1] and Ubuntu [2] images.
[0] https://news.ycombinator.com/item?id=30633670
[1] https://hub.docker.com/layers/debian/library/debian/stable-s...
https://www.thedrive.com/the-war-zone/3865/this-is-likely-wh...
Absolutely. I used to work as an SRE on Mozilla's WebPush infrastructure. Every running Firefox in the world establishes a connection to it; that means it peaks at tens of millions of concurrent connections every day. We could easily handle hundreds of thousands of connections on a couple CPU cores and gigs of RAM.
Although most connections were usually idle, we also regularly pushed messages to every connected client (e.g. when a collection in our remote settings service was updated).
It's written in Rust using Actix.
1) The performance per partition increased
2) The way AWS created partitions changed
When I was at Mozilla, one thing I worked on was Firefox's crash reporting system. It's S3 storage backend wrote raw crash data with the key in the format `{prefix}/v2/{name_of_thing}/{entropy}/{date}/{id}`. If I remember correctly, we considered this a limitation since the entropy was so far down in the key. However, when we talked to AWS Support they told us their was no longer a need to have the entropy early on; effectively S3 would "figure it out" and partition as needed.
EDIT: https://news.ycombinator.com/item?id=30373375 is a good related comment.
"This S3 request rate performance increase removes any previous guidance to randomize object prefixes to achieve faster performance. That means you can now use logical or sequential naming patterns in S3 object naming without any performance implications."
https://aws.amazon.com/about-aws/whats-new/2018/07/amazon-s3...
Mozilla has actually done some work to measure users with telemetry disabled; see the "telemetry coverage" section of https://blog.mozilla.org/data/2018/08/20/effectively-measuri...
I'm not sure how frequently they've done this or if any of the data has been made public.
The storage now being limited is for Gsuite- Classroom, Meet, Gmail, Calendar, Drive, Docs, Sheets, Slides, etc.
These aren't the products you'd store a lab's datasets in. They simply aren't designed for that and won't provide acceptable APIs, performance, etc. Thus although this change may stink for university IT, I don't see an alternate world where this lab had embraced Gsuite storage and was crippled by it.
It largely does.
https://support.mozilla.org/en-US/kb/enhanced-tracking-prote...
https://aws.amazon.com/blogs/database/readable-standby-insta...
The uptime.is website is a handy resource for these calculations. For example, http://uptime.is/99.9 says
"SLA level of 99.9 % uptime/availability results in the following periods of allowed downtime/unavailability:
Daily: 1m 26s
Weekly: 10m 4s
Monthly: 43m 49s
Quarterly: 2h 11m 29s
Yearly: 8h 45m 56s"I have the Dropbox app installed on a desktop computer which is always running and syncing (Local Copy 1).
Once a week I hook an external drive up to the desktop and take a backup via windows-built in backup utility (Local Copy 2).
I have Backblaze installed on the desktop continually backing it up (Remote Copy 2).
Bring on the front lines for such a crucial and complex piece of software and associated infrastructure is tough.
One of them is reporting all the processes I'm running. Certain keywords will trigger IT to reach out to investigate.
Another of them is intercepting all my web traffic, even going as far as installing its own CA and decrypting SSL. It's fun when that hiccups and I start getting SEC_ERROR_REUSED_ISSUER_AND_SERIAL errors everywhere.
This provides great incentive for me to keep personal usage off my work computer.
I agree that "the solver" is one flavor of the role, but I think there are a few other valid ones too. Many of the staff+ engineers I've interacted with fall in the "tech lead" or "architect" category.
I also like https://www.solarham.net/