The problem is that model is only being asked what the answer is most likely to be, not whether there exists a good answer.

There should be a different model that checks if there is an answer or not, like SQuAD 2.0 https://rajpurkar.github.io/SQuAD-explorer/