But yes, it would be weird to generate more stuff spoken by your father by using this technology. And beyond that, what's even the point? It's not your dad.
Yes in a few years you would be able to generate a complete avatar of someone, but it isn't them, and i think it will mess with you mentally.
I happen to be someone who believes that it's wonderful your dad left you with this artifact. It was a touching sentiment then, and now it can serve his obvious purpose many times over.
He didn't record himself as a side-effect of disease, or because he loved that particular story in the sound of his voice. He wanted people in the future to be able to hear what he sounded like!
Given that he could not have foreseen voice cloning (and therefore not explicitly asked for it) I cannot think of a more obvious example of someone wanting their voice to survive them.
I wish more folks would record The Night Before Christmas.
The reason is that if you speak with lots of verbal fillers, that's actually an important part of how you sound to other people. It makes sense to clean up audio for a podcast, but not for your great grandchildren.
A voice cloner doesn't care that you say "um" too much. It's parsing audio for phonemes.
You can use Descript, CleanVoice, and other tools to achieve exactly what you just said, in a few minutes, from just the original recording.
Just like with image generation models, this will massively raise the bar for what amateurs can do with a limited budget and limited time. It's hard to justify spending thousands of dollars on voice acting and art for a hobby project, but now amateurs can get something that is 90% there and substitute professional work if the project takes off.