There's actually LESS genetic diversity in a single breeding population than in two separate ones. When you have two, they can drift in different directions or be subject to different selection pressures. With just one, all of that stuff is swamped out.