Interesting. Very cryptic for simple user like me. I wonder if it’s useful today and for what purposes
This is a full drop in replacement for any transformer model use cases on model sizes 32B and under, as it has equal performance to existing open 32B models in most benchmarks
We are in works on a 70B, which will be a full drop in replacement for most text use cases
It's definitely something we are tracking to do as well =)