There are two AI developments that I'm quite excited for:
1. Very large foundational models (such as GPT5-level LLMs)
2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs
I think 2024 has been the year for #2, which is why the hype has died down a little. No splash big models that shock the world and make white collar workers shiver. But #2 is crucial to actually deploying LLMs to the masses.