Haven’t seen this on my M1 Mac mini; my wake times are faster than my monitors can wake. No performance issues immediately after sleep.

Maybe desktop platforms sleep differently than laptops?