I would not be fine with it as a man, also. All the cultures I am aware where younger couples live with one of the in laws, it is always the woman living with the man and his parents in their home, so my default thought process went to that scenario.
I suspect either parent would be a bit hesitant in a house that is "officially" owned by someone else "in the family" as it's a power imbalance.
And we see that rent-vs-own is a thing as it is, so it fits (I've heard people say they will have kids once they buy their own place, etc).