That is the only implementation I can think of that might make me trust a third party with confidential data.
Of course these massive transformers are already insanely computer intensive and adding FHE would make that orders of magnitude worse.
(And take away a, for many significant, source of income - data they can sell, train on, etc - So I’m afraid the incentive to research an implement it will be lacking)