Fine-tuning on a niche task I guess! E.g. a bunch of LoRAs that can be easily swapped depending on the task!

Will Google add performant 7B support? 7B's quality is good enough for a serious Web APP.

This is the problem. There isn't any use-cases for this other than being a toy. Even on the web.