Agreed. OP should schedule a meeting with the manager to find out how they're doing, if expectations are being met, etc. It's entirely possible that things are just fine, but the boss has the wrong idea about this particular employee.
I think it's a sign of bad company management, but it's by no means a dealbreaker. i.e., not something to quit over.