San Francisco, the densest city in the state, is 3/4 suburbia. There's no reason why it couldn't host 4 times the population without resorting to Hong Kong style urbanism (which would be great IMO, but that's a separate story). The infrastructure argument would make sense if homes in remote areas didn't also need that infrastructure, while suffering from lower efficiency in all measures.