Not all couples subscribe to monogamy. There is no reason to be judgemental about this in the absence of other information.
Feynman has been a huge influence on me. His outlook on science and the world helped shape my own. But we can’t ignore the flaws of our heroes, and it really sounds like he had a dark side.
This is how the crime of "Solicitation of Murder" came to be.
I do not believe “that is on the wife to say no, not on him”. If these allegations are true, he was a teacher engaging in predatory behavior. That is simply unethical due to the power imbalance. And the fact that he was asking people to cheat is unethical.