You can already do that on most desktop GPU's (even going as far as prev gen Nv 1050/1060/1070 for example).

You'll need a model able to work with tools, like llama 3.2 (https://huggingface.co/meta-llama), serve it, hook up MCPs, include a STT interface, and you're cooking.