Bitcoin absolutely does have counterparty risk, but it's pushed onto the exchange.
The coins are yours, but their value is almost zero unless you exchange them for currency. (Very few places accept BTC directly) Exactly like with company scrips, company credit or such means.