HNHacker News
TopNewBestAskShowJobs

drewbitllama

21 karma · joined August 16, 2017

submissionscomments
drewbitllama··on Resonance Audio: Multi-platform spatial audio at scale
Hi! Just to let you know, I've decided to add support for stereo, 5.1 and 7.1 speaker layouts in the Web version of Resonance Audio. https://github.com/resonance-audio/resonance-audio-web-sdk/i... Follow the repo to find out when the work is completed (hopefully soonish :) )
drewbitllama··on Resonance Audio: Multi-platform spatial audio at scale
Resonance Audio SDK is available for a variety of platforms, including Unreal, Unity, FMOD, WWISE, Android, iOS, the Web and VSTs. For the web version, it can be made compatible with any other code that uses the WebAudio API. Unfortunately, none of our API current supports multi-channel surround output as you're describing.
drewbitllama··on Resonance Audio: Multi-platform spatial audio at scale
Indeed. The bird has left the nest. ;)
drewbitllama··on Resonance Audio: Multi-platform spatial audio at scale
Hi!

Thanks for expressing your interest in using Resonance Audio SDK for the Web (formally Songbird). We don't currently offer a 5.1 rendering of the audio as an available option. However, we do offer .ambisonicOutput which outputs ambisonic content directly and this can be rendered to a 5.1 target using 3rd party tools (http://www.radio.uqam.ca/ambisonic/b_g.html). If we see a large need for 5.1 rendering, it may be worth considering posting an issue to Omnitone (https://github.com/GoogleChrome/omnitone/issues) which is our ambisonic renderer on the web. :)

drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Noted! Will add a better explanation to the README. :)
drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Haha. Actually, you might have had your headphones on correctly all along. S was "Source" and L was "Listener". I've added some clarification to the examples. Thanks for testing it out!
drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Hi Science404, yes indeed we're launching with the standard shoebox for now, but obviously we're thinking about the future too. :) Currently we calculate listener-based 1st-order reflections, optimized for performance. Once the ecosystem out there gets faster, we can explore fancier methods. ;) You can see this in EarlyReflections.js

Cheers, Drew

drewbitllama··on Songbird: Spatial Audio Encoding on the Web
:)
drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Hi Ben174,

I'm aware of the issue and I hope to have it resolved within the day. :)

Cheers, Drew

drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Hi Toomin,

Thanks for your interest! Let me try to clarify and answer your questions:

1. Songbird is indeed an enhanced alternative to PannerNode.

2. It internally works with ambisonics, but outputs stereo (we use Omnitone internally to render the multichannel audio down into a stereo track).

The general reason people use ambisonics instead of direct HRTF rendering is because ambisonics allows for head rotation prior to rendering, so the user can easily turn their head, etc. without you having to adjust all the incoming sources' hrtfs.

The reason we feel Songbird is an upgrade to PannerNode is three-fold:

One, you can control the quality of the localization/spatialization effect by adjusting ambisonicOrder (1st to 3rd, atm).

Two, PannerNode is costly... 2 convolutions per source, while songbird is a fixed number of convolutions irregardless of the number of sources, so it ends up allowing you to get more for less.

Three, PannerNode doesn't support any sort of room modelling and Songbird produces spatialized (ambisonic) room reflections and reverberation.

Hope this helps clarify things! :)

Cheers, Drew

drewbitllama··on Songbird: Spatial Audio Encoding on the Web
We're using a room acoustics model that captures early and late reflections based on the acoustic properties (dimensions and materials) of the room. :)
drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Hi!

Songbird renders stereo-out using Omnitone internally, so Android/mobile is certainly supported. Feel free to file any issues you have at https://github.com/Google/songbird/issues.

Cheers, Drew

drewbitllama··on Songbird: Spatial Audio Encoding on the Web
Hello everyone, thanks for checking out the new repository. I've resolved the CDN link issues, but feel free to file any more issues at https://github.com/Google/songbird/issues. Looking forward to seeing all the great stuff you all make with it. :)