> storing binary files like that in Git isn't as space efficient as using a plain text format

Why? Because git stores deltas?

At a first glance I'd expect a binary file to be radically more compact than the plain text equivalent.