It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
It works great.
Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-cachi...
All of these are lightyears behind US/China LLM offerings. None of them offer any model close to open-source SOTA. Runtime and reliability is a disaster and sure enough you have to pay a "sovereignty" mark up.
(Also no, modern science is (still) not incompatible with (the Christian) religion. I want my children to have both, as do I, or at least be taught both, so they can decide for themselves what they want when they are grown enough to do so.)
Who is sacrificing what, really?
Understandably too, because hetzner is running things on consumer hardware vs the enterprise hardware the others use
That's a pretty big part of why, honestly. How many of us are running server workloads that actually need the price/performance tradeoff of cutting edge server hardware?
They're great for hobbyists but people on here keep bringing them up as the flagbearer of euro hosting
ECC vs non-ECC is also pretty irrelevant on a box with < 64GB of memory
And no, ECC is relevant with less than 64 gigs of ram, there's a reason it's been a standard on servers since the 90s