It's a little funny that GVFS itself is hosted on GitHub which means you won't be able to pull it as a GVFS repo.
And the GVFS repo doesn't have the problems GVFS tries to solve. The current .git directory is only 425KB. You could put three copies on a floppy disk!