HNHacker News
TopNewBestAskShowJobs

selfup

103 karma · joined June 19, 2016

Systems Architect - Engineer AI/ML Practitioner - Musician Audio/Video Producer - Photographer Open Source - Security - DevSecOps Containers - Polyglot

https://selfup.me

https://github.com/selfup

https://gitlab.com/selfup

https://codeberg.org/selfup

[ my public key: https://keybase.io/selfup; my proof: https://keybase.io/selfup/sigs/zeb7OPc4pQ6U2r7tM07W7uCSu54nzt6bnF6-gJ9onPE ]

submissionscomments
selfup··on A GitHub repository was public-viewable
Fixture data (for testing) is fine. Sometimes a few lines is the minimum viable to test, sometimes a hundred or so lines of JSON. As long as the data is being optimized for testing and you aren't just storing a GB because it's easier.

I was replying to a comment asking why PII data shouldn't be stored in git vs a database. Just tried to give a general rundown of how to think about the tools.

Totally agreed that the data should have been synthetic/scrubbed and that a small sample set (large enough to validate) would be ok.

Sometimes a PDF or a few pictures are necessary (or just much simpler). I get that. I have seen some repos with an unreasonable amount of PDFs/Docs/pictures/etc.. and that's when a script that copies them into a gitignored directory from someplace (Dropbox/S3/etc..) is a better fit.

selfup··on A GitHub repository was public-viewable
The idea is that git is for source code/configs. Not data. Data gets stored in databases. Secrets/Tokens are stored in secret stores/vaults. Blobs like PDFs/etc should be stored in blob storage.

If a diff is not useful, don't store it in git. Doing a code review on PII is not useful.

You also shouldn't add packages in a git repo if they can be downloaded immutably in CI/locally. It adds a lot of space. Every commit is a snapshot + new code. Commits are not diffs.

selfup··on Optimizing Docker image size and why it matters
Yea CA certs are the first pain point I hit. Worth the hurdle. Noted on the timezone. Never really thought about that one. Thanks!
selfup··on Optimizing Docker image size and why it matters
Good to know. `FROM scratch` is such a breath of fresh air for compiled apps. No need for Alpine if I just need to run a binary!
selfup··on Optimizing Docker image size and why it matters
Had no idea about squash. Using cached layers can really save time, especially when you already have OS deps/project deps installed. Thanks!
selfup··on You don't need that CORS request
If you don't have an edge proxy (additional compute) you then accept all requests, or accept that a simple header is telling the truth.
selfup··on How I Build
I am on latest FF for Android (95.2.0) and it works.
selfup··on Why asynchronous Rust doesn't work
I have had great luck using rayon for distributing CPU intensive work across available cores. If you are doing I/O I can see why async is preferable but rayon is an excellent library for parallel work.

I have found that async or even in Go with goroutines, a large amount of small threads are not faster even if they should be in theory when it comes to CPU intensive work.

I use it to generate a 3D universe (at the atomic level) but store the data as enums.

Here is the repo: https://github.com/selfup/oxidizy

Big help from rayon:

1) https://github.com/selfup/oxidizy/blob/master/crates/unigen/...

2) https://github.com/selfup/oxidizy/blob/master/crates/unigen/...

3) https://github.com/selfup/oxidizy/blob/master/crates/unigen/...

Example perf generating an obscene amount of data on a 32GB machine with 16 threads (3800x):

Atoms: 110592000 Baryons: 26099712000 Quarks: 78299136000

real 0m12.779s user 0m0.000s sys 0m0.000s

selfup··on Ask HN: What does one look for in a laptop these days?
You can set this in the OS itself.
selfup··on VSCode deprecates Enable Telemetry, auto-enrolls you in Telemetry?
This comment isn't constructive at all. Keep it on topic and don't blame the messenger.
selfup··on 1password is considering a self-hosted option to store vaults
There's a chance it's using Tauri (rust) https://tauri.studio/en/ if it's truly not using Electron but a similar concept. However WASM builds in Electron would make more sense if they use the term Electron.
selfup··on RSA Algorithm
The end game is to switch to a post-quantum algorithm.

Essentially something that both quantum and classical computers cannot crack/brute force.

I would look into lattice-based crypto. It is one of the strongest candidates under review by NIST for post-quantum public/private key mechanisms.

selfup··on Can You Solve This? 1B Records per Second Data Streaming Challenge
Is there some kind of test harness for this? What does generic streaming engine mean here?
selfup··on Ask HN: How comfortable do you feel using cloud-based password managers?
I read up on their blogs and as much technical explanation as I could find, and by far 1Password seems to be the best with a cloud offering.

Also Apple buying into using 1Password company wide helps gain some trust (I am sure there was some serious auditing): https://medium.com/enrique-dans/apple-and-1passwords-deal-sh...

selfup··on From FOMO to JOMO: the joy of missing out
Did you mean Docker Swarm is being replaced by Kubernetes? Kubernetes is not a replacement for Docker.
selfup··on Chrome decluttering by removing some features
Unclear how I feel about some of these features being removed. Is it just in the menu or are the shortcuts themselves going away too?
selfup··on Ask HN: Best Linux Laptop Replacing a Macbook Pro?
Yea that machine looks nice. USB-C charge and I/O. Great for travel (1 charger for phone (android) and laptop). Looks like a slightly heavier X1 Carbon. Otherwise everything seems the same!
selfup··on Ask HN: Best Linux Laptop Replacing a Macbook Pro?
Lenovo X/T/P Series. Heavy discounts on the Lenovo website right now. And an abundance of refurbs on ebay that are in pretty much brand new condition.

Ubuntu 18.04 LTS / Fedora / Manjaro are all good on this platform.

Have fun picking!

selfup··on From Mac to Linux – the setup I've grown to love
Oh good to know! Thanks for the info
selfup··on From Mac to Linux – the setup I've grown to love
Yea this is a great route as well! Considered it but found a deal I couldn't pass up on a refurb x1c6 haha
selfup··on From Mac to Linux – the setup I've grown to love
YMMV but I use a X1 Carbon 6th Gen. 1080p/Matte screen. No dual boot so some things to tweak but not much at all tbh.

Installed erpalma/throttled from github to squeeze my CPU perf to max. Also make sure to set sleep to S3 in BIOS. Otherwise nothing else to do. Everything seems to work just fine.

The 7th Gen just came out so there might still be some issues but I would look around and see if it's good to go.

I use Ubuntu 18.04 LTS. Once 19 is done I will more than likely move on to 20.04 LTS

selfup··on From Mac to Linux – the setup I've grown to love
Yes indeed! And I will gladly attempt to finally dig into WSL at that point. For now I just use choco and pwsh and I find myself productive with go/node/elixir/rust without needing WSL just yet.

I mainly use Windows for games but every now and then I don't want to leave my desktop to make some changes to a repo while my character is respawning/spectating or something haha

WSL2 is going to be awesome for sure

selfup··on From Mac to Linux – the setup I've grown to love
I use Windows/Linux/macOS.

From a performance to value perspective you cannot beat Linux. Docker/Microk8s the overhead is so low. Dev speed is leagues ahead the unfortunate circumstance of having to run Docker/Minikube in a VM on Windows and macOS. Also filesystem IO is unreal compared to Windows at least.

Getting a refurb Thinkpad on ebay and having better compute hardware than a mac pro for half the price is also a nice cherry on top so to speak. That and the insane sales Lenovo has all the time for brand new machines is kind of hard to beat as well.

Next up is Windows from a hardware perspective. Same refurb thinkpad can dual boot without issue.

Then lastly macOS. I have had a mac since 2011. I am having a hard time with the direction Apple is going with their laptops.

I have all 3 and they all have their merits, but I find myself using Windows/Linux at home exclusively and macOS at work and I don't mind the context switch.

To each their own!

With the uncertain future of mac with their potential switch to ARM and not shipping python and ruby by default, I see some drawbacks to the dev ecosystem. I know brew will package a ruby version to handle this but I do worry about the ARM switch.

Linux used to be quite difficult, but I stuck with Ubuntu and the UX/UI has improved so much :)