100% agree. I'm a CTO for a vertical SaaS, working with a first-time founder with deep domain expertise. He came in with a thesis as to why our target customer was still using Excel, even though it was completely unsuited to their needs. Almost everything he thought at the beginning has been borne out, and there's no way I would have figured out this market on my own. There's also no way he would have built a usable product without someone like me - his original plan was bloated and we narrowed it to the core where we have very specific value.
I've been a solo founder as well multiple time co-founder / CTO at venture-backed startups so I'm certainly capable of starting something myself, but I think this combination is an excellent model. A couple of other things that make it work: the CEO has sales skills, and does not have much of an ego and is willing to listen to someone who has been through all of this multiple times.