Median age 27 Male: 98% Female: 2% Youngest: 19 Oldest: 64 Median prison time: 12 months Median probation time: 24 months
All of the above were Copilot inferred. Don't know why I need to know the above, though. :-)
Otherwise you're just as likely to be getting hallucinated answers based on the AI model's existing biases and training (if it's an American model, it might start telling you the sentenced convicts are young male and non-white even without looking at the data on the page).
Not sure if it's just OpenAI or if Anthropic has tried this too.
Eg. If we've already worked out premises that A is larger than B, and 2C is smaller than B, than you can easily compute the next token in the sentence "Therefore C is..."
versus computing 123,287,211 times 971,222, where computing the first token is non-trivial, but computing what comes after "11973" in the result is even less obvious. (it would be tremendously easier if you were predicting the result backwards, starting with the last digit).
There is some evidence that models actually "plan ahead" somewhat (something like guessing more than one token at a time, eg. when writing a line in a poem, the model has an "idea" of what the ending word will be) but there are limits to the reliability of that, vs. using a calculator tool.