The integration part (connectors) is the key here. I can see how beneficial this would be for companies as they can plug and play.

Adding the vectorisation locally is superb, I've played around with sbert models before and ability to run without GPU is going to simplify the process a lot.