Hacker News Reader

Comment by bflesch | Hacker News Reader

Would be great if you can just take a video and it would automatically capture the keyframes relevant for this type of transformation.

The end game would be that you put your phone in recording and on some stand, and you just have to slowly turn the pages of your photo album. One can dream.

View on HN

analyzing every frame of a video is very computationally expensive and the video resolution is often much worse than the photo resolution on such phones. But in principle the same techniques could be used so i don't see why it shouldn't be possible at some point.

I think there were some good counterpoints to what you said. But the most important one is.. USER.

People will record the video differently hence, adding more complexity to solving, comparatively, a simple problem.

One person might do the movements really fast, which leads to blur, which would mean they now need to add de-blurring. Other person might even miss an angle that was required. I think this is likely why panoramas are made in parts.

I bet that's probably the easier way to implement it, however the resolution on the camera is almost always better than video.

Is this very different from how it works? From what I can remember from the last time I used it, you point it at the image, and it gives you a set of points to center your camera around, automatically capturing the photo at those points, so you never have to press any buttons.

Turn the pages and wave the photo album back and forth :D

That would be extra processing analyzing frames trying to find the right ones. Again, the biggest problem with this is doing it on the phone at a reasonable speed.

Interleave a lower resolution higher frame rate video with the maximum frame rate of the largest size image (5-8 fps). Process the images in the background when the phone is wall power, and or push to cloud. It would be nice to do an incremental first pass to see if one has high enough quality source material.

Or use a hotword, e.g. "scan" after each page turn

Reply on news.ycombinator.com