Hacker News Reader

Note that it processes tokens at speed and cost of a 12B model though.

If it uses 2 experts, they should parallelize so closer to 7B speed?

Memory bandwidth is still a factor, right?