The DevOps around LLM/AI is a disaster right now.
You've got the data scientists tinkering away with the actual models where half of their stuff is in Jupyter notebooks. You've got the platform engineers sticking these models behind an API. DevOps making sure any model/code updates get propagated to prod in a safe and hassle free manner. Then you've got Infra who needs to make sure you actually have the specialized hardware to deploy these models onto.