No, you’re right. I’m not an expert and maybe I’m wrong. Just seems possible to build a better mouse trap here. I couldn’t build it, you’re right. Wish I had such skills. But I’ve looked into the topic and bit and noodled with crypto as a user and in principle it should be possible to build a skeleton key crypto system that isn’t much less secure. Just seems that way to me. Non expert guess.
I’m sure such tech could be evolved to solve the spof key issue (wouldn’t want your skeleton key leaking) for instance