lol, thanks! onnx, docker, and fastAPI on CPUs with AWS fargate. although i'm switching to GPUs in a month or two, so if you have any suggestions let me know.
I've also been searching for GPU solutions for potential small projects like this, and so far banana.dev and runpod.io seem promising.