Ask HN: Best way to configure Onprem DB+GPU servers?

Help HN. I'm director of ML at a series A pharma startup. Although we're small, we chug through a lot of data (typical datasets are 1Tb). The experimental side of the business is less data intensive and lives on AWS. However even data egress to our onprem GPU training machines makes putting our ML-db on AWS prohibitive. We basically need to configure a rack with a few replicated DB servers hosting ~10tb of data, and some quad H100 boxes. How can anyone buy such a rack without getting totally fleeced from a single vendor? Has anyone had any luck hiring someone who could build out and maintain a small server room for these purposes? Where did you find such a person? I'm open to all good opinions.