Show HN: A generative audio VST plugin using Gemini API, JUCE, and React
I've spent the last 8 months building a VST plugin called "The Infinite Crate" on top of Magenta's Lyria RealTime music model on the Gemini API. Doug Eck's research group has been building MusicLM and variants since 2017 (https://www.youtube.com/watch?v=yz-fHidp1M8)
I bridged a JUCE/C++ audio processing foundation with a React/Typescript UI, using Zustand to sync state. The plugin streams down generated audio from the Lyria RealTime model in the Gemini API via websockets
You can try it as a VST3 on Mac/Windows or AU/Standalone on Mac. It works in Ableton, Logic, and possibly other DAWs or video production software like DaVinci Resolve
The plugin allows you to type in prompts, adjust generation parameters like topk, temperature, bpm, key, and various mutes
Please try it out and give us some feedback :)