At the moment yes, but some phones let you disable Google apps through settings and I had this setup before. Another option is getting root access and uninstalling Google apps this way.