Hacker News Reader

Comment by ritwikgupta | Hacker News Reader

This is incredible. I took a talk recording I made for NeurIPS and passed it through this tool. The improvement in audio quality was night and day. It went from clearly being recorded in a bedroom to a studio-like experience.

[0, original] https://youtu.be/gwkCIdwHRhc

[1, enhanced] https://youtu.be/RPnUqmSyZ6Q

View on HN

The result is nowhere near studio quality. It's highly compressed and full of artifacts. I found the original to be more pleasant to listen to. It at least sounds natural.

It's so good it looks weird. It removed all the room acoustics, such that you would expect to see a mic very close to your face.

I feel the exact same way. It sounds like the mic is close to his mouth, but when watching the video it's clearly not there. It's super trippy.

I agree. I was also taken aback for the first few seconds. After those first few seconds, I think I was able to adjust to the sound.

This would be wilder if I were in an unconstrained environment with similar enhanced audio quality. It would seem like a voice-over.

Wow you’re right, this is a great improvement in quality.

Also, very enjoyable & clear presentation.

Thank you very much! :)

This difference actually has an audio “uncanny valley” effect because the voice and the video setting are so different now.

Use AI to separate the speech and remix the room noise back into the recording.

Or just remix the background to match the expected environment for the audio!

This seems to work well for certain voices and recordings and quite badly for others.

Is there any way one could easily train it on my own voice to make sure it isolates my or any other trained voice from noisy environments?

I was shocked at how good it worked in this case. Thanks for the examples!

I was shocked how (on my notebook) it sounds like there is something with the speakers.

I tried listening to it with my AirPods on. The enhanced audio sounds much more natural this way, as if I’m in the room with you.

Reply on news.ycombinator.com