Hacker News Reader

"Running your own infra" also includes managed infra like Bedrock, Foundry, etc.

Not just your local machines.

Enterprises are where you see this adoption. Legal, finance, tax; sensitive context where the data must be contractually opaque to external parties.

View on HN

Precisely. I have figured out a nice recipe that is quite affordable, 288G of VRAM for a little under 20K, it takes some fiddling though, but once it works it is really neat.

PCIe is incredibly powerful tech.

>> "Running your own infra" also includes managed infra like Bedrock, Foundry, etc.

Managed infra is, by its very definition, not your own infra. It's infrastructure someone else sets up and manages for you.

It's your own infra because there's a distinct line item cost for it versus OpenAI.

Same way you say "my apartment" and not "my landlord's apartment". It's your place while you're renting it.

Sorry, that distinction makes zero sense. Either way you're paying a monthly opex cost, compared to it being your own hardware, in which case it would be a fixed capital expense. Which is what "your own infra" means. I worked in managed IT services for 15 years. Trust me, the terminology is important and words don't suddenly start to mean what you want them to mean.

Reply on news.ycombinator.com