The main problem that I see is compression artefacts, especially in complex scenes with a lot of motion. For example filming a person or pet moving against a background of grass or gravel, or the camera panning across complex terrain. I even got it really badly just filming waves going in and out on the beach.
I know these are tough situations for to handle but it feels like bumping the bitrate would help a lot.