A few years ago I did the same thing with GPT-2 on my friend and I's WhatsApp conversation history.
So it would simulate conversations between us.
The result was hilarious yet at times uncomfortably accurate... like looking into a mirror...
So it would simulate conversations between us.
The result was hilarious yet at times uncomfortably accurate... like looking into a mirror...
There was some post-processing needed to get it in this format:
Alice: blah
John: blah blah
---
For finetuning GPT-2 I think we used this thing. I ran it on Google Colab. My friend ran it on his GPU, it should be doable on most modern-ish GPUs.
https://github.com/minimaxir/gpt-2-simple
I tried doing something with this a few months ago though and it was a bit of a hassle to get running (needed to use a specific python version for some dependencies...), I forget the details sorry!