I'm seeing a lot of AI firms building value added services on top of big tech "foundational" AI offerings. Value addition can start very early at a clear plans/billing structure, going through rate limiting, documentation and extra features that will bring stability or consistency to our AI enhanced products.
Going the other way around (I tried) and building things on top of big tech AI is challenging starting at the fundamentals as the OP described well.