The difficulty of mining is adjusted based on how many people are mining. I think it could have trouble if there was a very quick loss of mining power, but if it was a slower process and some miners gave up because it wasn't profitable it would start going back down in difficulty until someone somewhere could get some profit out of it.