I remember writing chatbots just 5 years ago, a major challenge was how infer structured output using a neural network.

Now you just use text output to generate raw json and parse that. Crazy times.