I guess I would counter with if I have friends there, I would like their lives to be better. If my exit interview is able to do that, then I would take that as a net positive.
But they’ll, even subconsciously, remember that I said Joe and Jane were absolute rock stars.
However, you should also be either convinced that HR gives a crap, or that any potential outcomes are acceptable, including but not limited to being moved into "unregulated attrition" status, losing the ability to be hired by the same company in the future, having your words potentially turned into a lawsuit against you, etc. Unless you have actual, legal, signed documentation in place giving you such assurances, these are all on the table.
If you had any confidence your feedback would be listened to and actioned on, why would you be leaving?