I don't think it's font scaling. It's a fundamental change to the font renderer. Basically, subpixel rendering is gone and it's all grayscale.
http://answers.microsoft.com/en-us/ie/forum/ie10-windows_8/w...
I've not played with 8.1 yet, but hopefully it's been addressed.