In March, I was confident edge level usage of large models wouldn’t be possible soon.

Distilling large models into smaller parts, has gotten better than I anticipated.