I think one red flag that people often miss, or make excuses for, is this: management not treating a coworker fairly.
When you're not treated fairly, that's clearly a red flag. But many people see coworkers treated poorly while they themselves aren't, grab a beer after work and talk about it, commiserate etc. but don't consider the possibility that maybe they themselves are next.