I wonder how viable it would be to apply this to Qwen3.8-27b
Right now running it locally is about 7-11 t/s for me (16GB 4080 and plenty of RAM overflow). If it doubled or possibly tripled this, thats a game-changer
Right now running it locally is about 7-11 t/s for me (16GB 4080 and plenty of RAM overflow). If it doubled or possibly tripled this, thats a game-changer
No comments yet.