I think the main reason for base64 encoding is to allow you to store binary data into a secret. Not a security measure. The kubernetes docs say as much: https://kubernetes.io/docs/concepts/configuration/secret/
As Joe notes, this was just how you most easily encode binary data in JSON. We did discuss that the encoding has a minor benefit to “over the shoulder reader” obscurity, but that wasn’t the goal.