This is fine if you're committed to using (say) AWS KMS for your encryption needs as a service with its per-API-call pricing.
The costs of that obviously scale in a completely different way from the per-key storage costs (which are actually zero, I think).