I've even thought that, after infancy, apartment living is potentially BETTER for kids. Reasoning that there are more nearby friends and usually a playground or field to play in. I certainly had lots of fun with the neighborhood kids in the pool/large field/playground on the apartment grounds when I was young.
But, kids are noisy during quiet hours (before you can reasonably control them). I remember it being hard on my mom when my brother was young. Always 1/2 a step from eviction for noise complaints. I felt the stress as a child, I cannot imagine how hard it was on her. I don't want to do that...