Random reboots, program crashes, kernel panics/BSODs, boot loops, and wavering displays are some of the things I've seen, aside from the system just not powering up.
Yeah, my old PSU would just shut down whenever I play an old game with vsync off. I’m thinking it couldn’t keep up with sudden power requirement. I recently replaced it with a better PSU and I’m not getting any of these shutdowns again.