If the user agreed with Google's conditions others who are entering the environment where the device is located might not.

I personally wouldn't feel at ease in a house with a 'smart' device that listens and sees everything all the time.

Those devices are a great way to keep some friends and family away.