This can work great until the models get tweaked and you realize you’ve been working based on the currents of the model this week.
Creating a robust enough setup that can work on different models or different versions of a model is critical.
Creating a robust enough setup that can work on different models or different versions of a model is critical.
even with a robust, well thought through setup every model behaves in its own way, some adhere more to a system prompt, another model has more recent cut-off time and knows about new parts in the stdlib
some oversteer, some understeer …
if you want the best performance unfortunately there is not really a way other than to constantly adapt the harness/clutches/context to the model du jour
In a non-deterministic world the compiler is no longer consistent anyways.