So when would be a good time to start using git - perhaps when the project is deployed into beta?
(Although I mostly skip using Git in toy projects, and just backup to Dropbox).
[1] If you push your changes to some offsite remote like Github, you are also backing up your code.
My suggestion was that it is faster to code directly on the VM or use rsync, than to push code on GitHub and pull it on the VM.