I've seen this rhetorical point being used before, in several contexts, and it never makes any sense to me. It can be used to disregard any argument in favor of the existence of something.
Let me explain why with an example:
"I'd rather live in a world where my wonderful daughter exists, even if she has flaws and throws tantrums, rather her not being born at all".
"Well, we live in a world where a lot of potentially wonderful babies were never born, aren't we?"
And my answer is: yes, but I am talking about ONE specific baby (or book) who matters to me. Who cares about the others that never existed?