> I didn’t get a family size discount on my home

You do though. The cost of kitchen for a couple without kids, and one for a family of 5 is roughly the same. You might have more square footage overall for house, with more people, but the construction costs are concentrated on the shared spaces like kitchens or even things like living living rooms where square footage will scale sub-linearly with the number of people in the household.