However, I would say: I re-watched GoldenEye recently, and - maybe it was because I'm in the industry and notice these things more - but the blatantly different stunt men (especially landing the Cessna in Cuba: the man looked totally different compared to the actor who should have been flying!) compared to the actors did make me personally go "hang on a moment, who's that?"
Some of this stuff can now also be automated to a degree (not completely, it still requires artist input, and sometimes a lot), but it's not often Rotoing every frame like it used to be ten years or so ago.
Things I'd personally argue aren't worth artists having to work on, but I know they do, are things like skin wrinkle removal on leading actresses, removing mustaches on actors, etc. And the biggest issue is clients changing their mind at the last minute, often having previously signed off on lookdev or anim at the earlier stages, or just generally having to deal with bad set preparation because the 'talent''s time on set is 1000x times more important than the unseen artists, who then have to do loads of work to compensate for badly lit (very un-evenly lit) greenscreens or lighting on set, because the on-set VFX supe was likely ignore when he complained ("Oh, they can just fix it in post").