I wanted my students to be able to run open source models. Easiest way was using ollama, and ollama web ui (now open web ui) on google cloud for .18 cents an hour with a 4-core nvidia and 16 GB of ram on a spot instance. I created a tutorial for my students:
https://docs.google.com/document/d/1OpZl4P3d0WKH9XtErUZib5_2...