Using GPT-4 for Data Transformation Without the Pitfalls

We have had this feature operational against Huggingface models (pre-RLHF advancements) but didn't launch it because it was very brittle. ChatGPT (gpt-turbo-3.5) works reasonably well but GPT4 can handle complexit much better.

More importantly, the set of formulas we support are not always one to one with Excel. We try to keep them the same but sometimes improvements and additions are needed. So we have to feed in a pretty complex prompt with a bunch of context (like source and destination types, schemas, validations etc.). With GPT4, we can do this with less explanations and higher accuracy.