It might not be listening to you but it's almost certainly reporting on everything you do on it, your location, your contacts etc all the time.