Only time I've seen a manager joke like that was with a senior engineer that also joked about quitting fairly often. It was banter and it worked for them. Same manager never joked about it with anyone else though.
In general, though, never a good joke. And even with friends, be careful.