Hacker News Reader

This app shows how dangerous it is to trust ChatGPT for anything even somewhat important.

I just threw in a simple example news video and while it did summarize the video somewhat accurately(it got senator Joe Manchin's name wrong), it missed complete segments! (the "Goodbye Toyota e-TNGA" segment)

[1]:https://www.youtube.com/watch?v=UM4n1Isfr6E

[2]: https://i.imgur.com/RyFStVm.png

View on HN

Yes, it's still far from perfect, sorry about that. And it's not about the GPT. I'm sure I can greatly increase the quality on my side.

Your app is slick and works great. How can you increase the quality? I thought you just pass the subtitles to chatgpt and return the results?

It's not that straightforward. I would say that the most important part of pre-processing is how to break the transcript into parts.

But there are many more things to improve. It's a pipeline: you can add more models, you can train them, you can change prompts, you can post-process the results. But it takes time. More time each step.

Ah ok then maybe I was too harsh. Your app is pretty cool. Great job!

Oh, it's okay! In the end, what matters is how much value it gives the user, not how complicated it is inside! thank you!

If you have access to chapter markers, that might be a solid way to segment

Reply on news.ycombinator.com