That's probably more because of RLHF though, they've optimised for certain kind of responses rather than simple model loss on internet text.