Hacker News Reader

Comment by Rodeoclash | Hacker News Reader

Interesting!

I'm currently working with video in the context of gameplay feedback on video games (https://www.volt.school/ is my example app, https://www.vodon.gg/ if you want an instance of your own)

I'd love to be able to detect certain events that happen in the game stream. Things like the player killing someone, picking up a a particular item etc. Adjacent to this, I'd also be interested in your infrastructure around hosting and processing the videos. I'm currently pigging backing off YouTube and in the V2 of my app, I've moved to Cloudflare Stream but I'd love to know how you're working with these massive video streams in a cost effective way.

View on HN

Most of the time, we work on processing video data after it's been hosted somewhere for us to seek by frame or download. We don't yet support video streams but have heard multiple people bring it up.

Our infrastructure is really good at filtering for parts of video where things are happening ("interesting") and being able to parallelize video processing by cutting it up into multiple pieces, running more granular models on those parts, and smoothly interpolating metadata using surrounding frames. You should check out the processing section of our FAQ page (linked in original comment) for a more detailed explanation of how our processing works.

If you're worried about just streaming seamlessly, Mux has a great solution: https://mux.com/live.

Also, for detecting things in e-sports feeds, feel free to reach out to the email in my bio!

Ah, I'm not working off streams (yet!). Users will use a screen recorder to capture gameplay and upload it later.

Thanks for pointing out the FAQ.

I could see this technology being deployed to automatically have people arrested for crimes that occur on camera or any remote sensing medium for that matter. Gape recognition and face recognition are more than enough to identify an individual even without voice or cell data. Luckily deepfakes are here to save us all by completely invalidating any sort of media authenticity.

Reply on news.ycombinator.com