Perhaps you can learn without a calculator, but these timed statistics tests do not function without one. Do you really expect people to do repetitive operations on even n=10 datasets when they only have an hour? You can’t use Excel (because it’s on more capable PC that you can use to cheat).
At the end of the day, if you want to remove the calculator from the statistics classroom you probably also have to remove the standardized test.