Nice - exploring the use of home assistant for something similar. It already has all the integrations and API's for control, just lacks the Chat GPT plugin.
They are very easy to make - it's just an API. The main difficulty at the moment is just getting access to them. There's a long waiting list for develop access.