bejager··on Towards Optimal LLM Quantizationnot yet but it's something we have in mind as a future feature.
bejager··on Towards Optimal LLM QuantizationWe continuously work on expanding SDK support, Rust is also on the list.
bejager··on Towards Optimal LLM Quantizationwe don't support Falcon 2 yet but new models are always on our radar to be added to the platform.