I've not tried this, however https://github.com/AGWA/git-crypt

Apparently someone has developed something similar to this