Yes, but while you have it on Coinbase you just own a marker.
Until you can't.
Uh that'd be stealing and would make them immediately lose credibility. But if you're really concerned about it, move funds to your wallet as soon as you buy.
Because that's never happened (see: QuadrigaCX, Cryptopia, ...)