Google quietly open sourced a 1.6T parameter MOE model

This is a link to a reddit post which is a link to a Twitter post which links to this... https://huggingface.co/google/switch-c-2048

Yet another Reddit link. Yeah I'm not sure about this trend

fwiw this specific subreddit has very "hacker news" like conversations, and is very technically focused.

So this is a link to a actual conversation about it.