You can enforce grammar. Llama.cpp can do that, without any need to change models.