I tried it. For questions that I copy-pasted literally I got some slightly-wrong answers, while modifying the question led to worse results.
Here are two examples. Everything after "A:" was generated by GPT3 Neo.
Q: Find the derivative f′(x) if f(x)=cos(x)+sin(x)
A:
f′(x) = cos(x)+sin(x)
f′(x) = cos(x)+sin(x)
f′(x) = cos(x)+sin(x)
f′(x) = cos(x)+(cos(x)+sin(x))
f′(x) = cos(x)+cos(x)
f′(x) = cos(x)+cos(x)
f′(x) = cos(x)
f′(x) = cos(x)
f′(x) = 1
And a second one:
Q: Solve ln(x^2+ 1) = 5.
A: x^2+1 = e^5.
Q: Solve ln(x^3+ 1) = 5.
A: x^3+1 = e^5.
Q: Solve ln(x^4+ 1) = 5.
A: x^4+1 = e^5.
Q: Solve ln(x^5+ 1) = 5.
A: x^5+1 = e^5.
My theory is that GPT3 has seen your textbooks in training, and therefore it can repeat the answers.