I tried it and it worked great, congratulations! Looking forward to having chapters or at least separate paragraphs, I think you're doing right by giving that priority, as you mentioned in another comment.
Chapters should come first then?
Is it possible to get the chapters directly from YouTube? As many videos already have them defined by the creator.
Most YouTube transcripts lack punctuations.
So this app adds them back using a deep learning model based on DistilBert converted to ONNX for inference in your browser.
I saw it was running within the browser. That's beyond awesome.
It’s amazing what Xenova Transformers JS can do to run ONNX models. And WebGPU is coming soon!
This is great!
Do you rely on YouTube captions or do some sort of ASR?
It uses the existing YouTube transcript and adds punctuations using a deep net that runs in your browser
Very cool, curious if you plan to add a summarize feature along with this? I know there are other apps that do that already, but would be good to follow along inside the same single app.
I would like first to generate chapters (perhaps using a T5 model). Summarization is also possible.