Salarymen who quit are not likely to be salarymen again
This I don't think is true anyway. It has always seemed to me like a socially manufactured platitude to keep people erring as much on the side of safety as they can possibly reach. For the average person, it might be a very reasonable default, which is why the platitude tends to stick.
Otherwise, I don't know if the social reservations are worth worrying so much about. It's hard to tell how much of this is people legitimately looking out for you, and how much is them preemptive prevention from having to envy you and what you did that they couldn't bring themselves to do.