Yes, having a performant CI server on premises would probably pay itself in less than three months.

Startups are usually resource-rich and time-poor, and don't want to allocate employee time to infrastructure unless it's core to their business, so arguments for efficient spending there are easily overlooked.