Your first point is interesting. I’ve been meaning to explore some of these options lately (llama.cpp). I’m a bit too smooth brained to build a good business offering around that.