That seems reasonable to believe. However it would be difficult to prove, because this configuration will rarely exist in reality. People whose genes bias them toward traits we think of as "loving" will tend to actually be loving, and therefore their children will not be emotionally neglected. I don't know if I could express certainty either way on this proposition.

(For anyone who thinks it's impossible for loving-ness to be genetically programmed, read about the domesticated silver fox experiment.)