We actually already have this: the combination of Home Assistant, ESPHome, and HA-MCP/CLI.