Q: What Is the distance from Chicago to Tokyo? A: The distance from Chicago, United States to Tokyo, Japan is approximately 8,113 miles (13,055 kilometers) if you were to fly in a straight line. It takes approximately 15 hours of flight to reach from Chicago to Tokyo.
Which is fun because it is also wrong, but gives a different incorrect value.
Q: What is 3 to the power 73?
A: 3 to the power 73 is equal to 3 raised to the 73rd power, which can be calculated by multiplying 3 by itself 73 times. 3^73 = 3 * 3 * 3 * ... (73 times) = 3 * 3 * ... * 3 (73 times) = 1.43382043e+22 So 3 to the power 73 is approximately 1.43382043e+22
Also incorrect but a different value. If I change the question slightly, for example, by dropping a question mark or saying "Three to the power OF 73" It also gives a slightly different incorrect answer.
What I find really interesting here is that if I ask it the exact same question it gives the exact same result. But then if I open up a new instance, it will give a different incorrect answer, and repeat the incorrect answer again only if the question is identical.
Edit: This could be a decent method of fact checking for anyone determined to use chatGPT; phrase the question slightly differently and compare the results (never input the exact same question twice).
Interestingly, it now correctly outputs Honduras for the second largest country in South America, but if you ask it to list them by size it will get most of the rest incorrect.
My own experimentation with ChatGPT made me dismiss it, but I was asking it comparatively difficult questions about linear algebra and programming. I'm kind of shocked it fails at these basic questions I would have thought it would be more than capable of handling.