Location location location.
Where there are more eligible men than women - men have to work harder.
I suppose if women outnumbered men by four to one then men might be able to slack off... except such a society would almost certainly reinstitute polygamy, so men would have to work harder than ever to compete for quality and quantity of wives.