Nope. Only people who need to leave the country have passports. This generally doesn't apply to the working poor.

~35% of Americans have passports. No reason to get one until you need to travel abroad.

Passports exist here but not everyone has one. Off the top of my head, I'd say that most people don't have one.