Oh nice! I'm curious to know how you did the finetuning. I've been thinking about it as well.

You're correct about the approach. Sometimes it mixes the sources for whatever reason, but gotta investigate it more.

For the sourcing, I used a small variation of perplexity.ai's prompt: https://twitter.com/jmilldotdev/status/1600624362394091523/p...