I keep reading comments saying it's useless from people who clearly haven't actually used it.
I'm building and using this machine daily for building and using applications with LLMs, TTS, STT, ASR, and image generation.
I'm building and using this machine daily for building and using applications with LLMs, TTS, STT, ASR, and image generation.
https://github.com/kyuz0/amd-strix-halo-toolboxes
It takes all the work out of it, you just start llama-server in the container context and you're off doing inference without having to figure out dependencies.
Before anyone gives me grief my company has a strategic partnership with Nvidia, I do AMD under the cover of darkness. So I live in both worlds. I’m a bleeding heart for the under dog…if being a 360B market cap company makes you the “under dog”.
I don't know what you want me to tell you, you're welcome to believe whatever you want but that doesn't change the reality I experience actually using the thing.
Benchmark numbers and first hand reviews are readily available if you bothered to look.
For example: For LLMs, it's easy to do the math, and see how long you will be waiting for 50k input tokens.