you mean like a Shepards Tone (https://en.wikipedia.org/wiki/Shepard_tone); i wouldn't doubt they slowly tweak quants to try to eke out.
there's also probably load balancers that downgrade models during high use.
there's also probably load balancers that downgrade models during high use.
No comments yet.