The right to medical privacy should weigh much more than Google's right to spy on communication between you and your doctor.
I'd say the same for communication in general, if possible, but using Android without Google is difficult for the average user.