You could buy 4-6 machines like that per year at that price. Gives you a taste of cloud mark-up. Bandwidth markup is far more insane.
If someone has a microcenter nearby, they could build an 8 core ddr4 system with 128gb of ram for maybe $800.
$3200+ could build a 64 core/128gb ddr5 rig.
https://www.newegg.com/tyan-s8050gm2ne-9534-amd-epyc-9534-2-...
Non-ECC issues are statistically rare. You might never see them if you aren’t running a lot of systems at heavy load at scale.