So there used to be a thing called Sandy that did the same sort of thing.
http://lifehacker.com/321644/sandys-your-personal-assistant-...
http://lifehacker.com/321644/sandys-your-personal-assistant-...
Their initial email states, 'P.S. If you'd prefer a male assistant, my brother Andrew would be happy to schedule your meetings. Just CC andrew@x.ai on your meeting requests instead of me.'
And it can create a cognitive dissonance if you allow people to modify half-assedly - eg. it annoys me that I have to ask Siri for help when I have set Siri to be an Australian male voice.