People are not talking enough how huge this is for robotics and IoT. Current robotics arhitectures are limited by tok/sec. How cares if its not a Fable model?
This move undercuts NVIDIA directly.
This move undercuts NVIDIA directly.
Maybe AI models may become reduced to a collection of tiles you add to a chips one day, maybe sooner for some areas as you say, motor control for balance, vision systems, speach recognition systems etc, broken down, for robotoics, much is already there and just cost of battery/power holding much back.
It doesn't actually specialise in anything in particular that one can point to.
For this reason you can really transfer them between models.
There's also Mixture of LoRA Experts, which instead of slicing up the model and routing through that, routes through different LoRAs.
But it all comes with tradeoffs, as you have to train and run the gating network doing the routing, which also comes at a cost.
the implications for mental health of pet rats is huge.