An account is controlled by a key AND the validators who choose to record their transaction. One cannot just share the key with others. First, they need to record it with ledger keepers. How is it not like transfer agent?
At best the key signing is providing a partial audit trail with no case law to support any liability transfer created by its use. Typically transfer agents take very little liability by requiring a medallion signature before allowing a transfer.