Genuine question - How hackable is this? Can I have the voice commands redirected to my backend server where I can process it as I please?
Inside Home Assistant the processing is delegated to integrations providing Speech-to-Text, command processing, Text-to-Speech. You can make custom integrations for all of them