Are you running git outside of the encrypted container? Or are you running it inside (versioning decrypted files)?
If you are doing the former, I used to use git-annex[1] for a similar purpose and liked it to keep track of where the encrypted versions of files are stored.