That would only be anonymous to the recipient. Google still has a map from your actual account and phone number to your Google voice number.