Hacker News Reader

isnt the active parameter count more relevant than the total? qwen is a dense model no?

For some tasks yes, and we don't know how many active parameters Luna is using..probably less than 27B

Is Luna MoE? Had no idea OpenAi went that direction

We don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.

Right, I guess the ”Open” in OpenAI means open for speculation.