I doubt the VUs can help with inference given their small scratchpad sizes and instruction set though, haha.
142 karma · joined January 7, 2011
I doubt the VUs can help with inference given their small scratchpad sizes and instruction set though, haha.
https://hardware.besly.de/index.php?hardware=Wireless_Networ... https://discuss.haiku-os.org/t/support-for-realtek-usb-wifi-...
But my use case is just to have a nice-sounding local TTS engine, and current text-to-phoneme conversion quirks aside, OpenVoice seems promising. It's fast, too.
Following the instructions in their repo (and moving the checkpoints/ and resources/ folder into the "nested" openvoice subfolder), I managed to get the Gradio demo running. Simple enough.
It appears to be quicker than XTTS2 on my machine (RTX 3090), and utilizes approximately 1.5GB of VRAM. The Gradio demo is limited to 200 characters, perhaps for resource usage concerns, but it seems to run at around 8x realtime (8 seconds of speech for about 1 second of processing time.)
EDIT: patched the Gradio demo for longer text; it's way faster than that. One minute of speech only took ~4 seconds to render. Default voice sample, reading this very comment: https://voca.ro/18JIHDs4vI1v I had to write out acronyms -- XTTS2 to "ex tee tee ess two", for example.
The voice clarity is better than XTTS2, too, but the speech can sound a bit stilted and, well, robotic/TTS-esque compared to it. The cloning consistency is definitely a step above XTTS2 in my experience -- XTTS2 would sometimes have random pitch shifts or plosives/babble in the middle of speech.
https://lore.kernel.org/linux-mm/45odvhgymm7fxsgwpewoiiggaok...
- Jef Raskin
The latest version of the Logitech software (G HUB) doesn't make this feature obvious though, you have to set a local profile then click the gear icon > my gear > click the mouse image > switch on on-board memory mode > click Slot 1 (Default) > click replace with [the profile you just customized, usually Desktop (default.)
The old Logitech Gaming Software was much simpler in this regard.
https://www.reddit.com/r/firefox/comments/5wio45/mozilla_acq...
[edit] also nnethercote is a Mozilla employee :)