The phrasing was a bit ambiguous but I’m pretty sure that they meant: “when it appears, it answers my question 50% of the time”
Me latching onto the "appears" does not change anything since even with your interpretation it is wrong 50% of the time and that assumes that the 50% of the time you think it is right you actually know it is right and it is not actually wrong but you never check.