Just tried this out and got the default working in a few minutes! Would love to see more support to use finetuning dataset format used for OpenAI and handling for history.
Right now, we are focussed mostly on offering support for open-source models but we can definitely extend support for OpenAI formats.
May I ask what history means?