What are you describing is one possible explanation for how a bottleneck happened, but your scenario would still result in a genetic bottleneck.