Hacker News Reader

Does the model quality become degraded in other ways?

no because we freeze the main weights and only train our added weights.

It's impossible to add weights which degrade the quality?

Not if the new weights don't influence the old outputs.

Aha! I thought this was feeding the confidence info back to Gemma for some reason.