Signal's increasing reliance on SGX is the elephant in the room. They keep announcing new features that require sending your cryptographic keys to someone else's "super trustworthy" computer.
Nobody relies on it. But if we can make an attack 10 times more expensive (because we can't prevent it completely), why not do it?
Secure remote computation is better than nothing. I'd start having problem with it when people rely on it when there are better solutions, but that hasn't been the case so far, AFAICT.