You can be wrong about your level of confidence just as you can be wrong about the rest of the world. Either is just a prediction made by your neural network.