It depends! If a startup is entering with a large model to face other larger models, it must be better at least in 1 meaningful dimension.
500B params performing worse than other OSS of the same size is pretty meaningless if no one will use it.
500B params performing worse than other OSS of the same size is pretty meaningless if no one will use it.