116 karma · joined October 27, 2021
https://www.tomshardware.com/reviews/amd-ryzen-9-7950x3d-cpu...
Great write-up! I'm eager to test a few of these methods out in the lab
This was a common occurrence that people referred to as 'brown billing' because the shutoff notice had a brown header instead of the green header on your regular utility bill.
Start small, pick one service at a time (compute this quarter, postgres next quarter, secrets management the next) and use the emerging platform to strangle out paid services
Cloud team gets to stay cloudy, on prem team still gets to farm servers
I've put together multiple hybrid and multi-cloud setups between gcp, aws, azure, equinix, and others using terraform.
Iam tends to be very different between providers but there is absolutely a lowest common denominator between them especially when you focus on compute, storage, and networking as primitives with which to host your own services.
You'll get quite far by consolodating requirements into a json file containing a list of ports to open, ip addresses to allow, required number of cores, disk space, operating system version, max spot bid price, default region, maximum desired replicas etc...
Another factor is how you provision your machines. Cloud-init radically simplifies the process of creating homogenous instances across providers versus custom packer images, ansible playbooks, puppet etc... and is supported by almost every cloud and exposed via their terraform provider
Metal3 is just a wrapper for Ironic from open-stack.
The two work together to re-image bare metal machines and attach them to clusters as nodes which can then be sliced up into smaller virtaul machine nodes to sell to your end user which they can then use to run docker, kubernets or whatever else they want.
Doing this allows you to have full kernel level isolation on a per-tenant basis which is not possible just using normal containers.
It also allows you to pin workloads to specific CPU cores for latency sensitive tasks as well as pass pci express devices through to individual VMs on the host and other fun things
It's really only useful if your problem is 'i have one really big computer but I want to have lots of small computers instead' but that's pretty much every data center so shrug
ClusterAPI (CAPI) enters the equation in that CAPI requires Virtual Machines or Bare Metal machines as inputs which it then uses to create a kubenrtes cluster. Thus, kubernetes in kubernetes with kernel level isolation on a per-tenant basis
Just because you made it doesn't mean anyone is obligated to buy it
I'll trade you streets and you can deal with the 3 dead kids from traffic incidents over the last 5 years
Labels are definitely more harmful
Vast is a grey-market with very few security measures in place. A host can snoop on your workloads very easily for example because they have full access to the docker host.
You're also limited in that you can only deploy a single container so if you just wanted some spot nodes to scale out your existing Dagster cluster etc.. You're not going to be able to cleanly plug Vast into your existing infrastructure deployment process.
But if you're just playing around or don't have major security/data restrictions and only want a jhub notebook or nvidia-glx-desktop then yeah it's a very hard deal to beat.
The games industry specifically has a chip on its shoulder with regards to linux and scaling as well as a general refusal to NOT poorly reinvent every wheel in C++ inside their windows-only desktop client.
Otherwise you wouldn't see goofy shit like Square Enix halting sales of their game because they couldnt scale their snowflake out to general-purpose servers