What you are describing is how to remove _access_ to the secret. The issue here is, that the former employee still has _knowledge_ of the secret. Hence you have to rotate the secret.
Obviously, nothing you do w/r/t secret storage is going to resolve the problem of what's in your employees' heads.