"Hiding" a file as a raw blob with a tag pointing to it, isn't bad if the thing should be able to expire.
If a thing is truly expired, then why have it fill-up the commit graph.
That said, a public key - even an expired one - may have value in keeping around: Verifying older historic releases.