Hacker News Reader

Comment by wkat4242 | Hacker News Reader

Yeah it sounds like a great option to place a camera invisibly in the middle top half of your screen so you can actually look a person in the eye when videoconferencing. No more weirdly looking down or to the side for everyone.

I'm sure it can be used for creepiness as well but I see the benefits too.

View on HN

iPhones solve the camera angle by changing the position of the pupil in software instead.

1986 solution vs cyberpunk solution

how did we even get here?

Are you sure? I remember that being present briefly in a beta several years ago, but then it was removed. I don't remember it ever coming back.

Some searching says it was trialed in iOS 13 betas, but didn't make it into the final cut. It was released with iOS 14 though.

https://ios.gadgethacks.com/how-to/disable-facetimes-creepy-...

Oh, TIL.

Given that this will probably only produce a relatively low res, high SNR image, it might be the sweet spot is to use this tech to capture a true eye-contact perspective from the glass in front of a screen, then neural net combine it with images from offset cameras, to create a 'true' through-the-screen view.

why stop there? one rendering for each eyeball

It’s a bit uncanny valley though, right?

I’ve never noticed it, so apparently not.

Nvidia Broadcast has a similar feature but it's really bad and completely unusable if you wear glasses. I don't have an iPhone to compare.

It seems to work fine with glasses for me. Only it loses tracking if I look too far away (bottom of the monitor). Also it thinks I have olive green eyes for some reason.

Which versions of iphones do this?

Any model newer than iPhone X (XR/XS and up).

It's a Facetime exclusive, though - no API so other videoconferencing apps can't use that.

Having the screen be the camera 1) removes the need for the holepunch as well as magic island workaround 2) could clearly be used in tandem to improve the effect, even potentially reducing the required computation. Sure, Google also fixes images in post, but that's still not a substitute for better cameras. You're always information limited.

I believe Nvidia offers something similar with Nvidia Broadcast[0]. [0] https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-...

This doesn't solve the issue, because it looks like the person is always making eye contact! You don't want that—you want it to look like the person is making eye contact only when they are actually making eye contact. Constant eye contact is exhausting.

It does what??? How have I never heard about this before? Is this deployed right now? Is it always enabled? I have so many questions, don't even know where to start. That sounds amazing.

If I look at my camera lens when I'm talking and I look at the screen while you're talking, and then you do the same, then there's no issue. Am I the only one that does this? (I know the answer. I am. At least at my company, I am.)

This feels normal if you make videos but it's pretty unnatural.

Reply on news.ycombinator.com