Git refs can be packed (see https://git-scm.com/docs/git-pack-refs) so it's not just about checking if a file exists.