> They continue to use AI for math (asking LLMs to split bills, for example)
Ah, yes, high tech solutions for low tech problems. Let's use the word machine for this number problem!
Ah, yes, high tech solutions for low tech problems. Let's use the word machine for this number problem!
I've tried to explain it in those terms as well: every medium-sized prompt on these large models consumes roughly one phone battery charge worth of energy. You have a phone with a calculator.
I'd ask them to do the math on how much energy they're wasting asking stupid things of these systems, but I'm too afraid they'd ask ChatGPT to do the math.
The energy consumption per prompt will decrease for the same task complexity, as inference hardware gets better (as they already have from the 2023 paper that reported 3Wh).
You know, that's a thought process that makes internal sense.
You have someone who's terrible at math. They want something else to do math for them.
Will they prefer to use a calculator, or a natural language interface?
How do you use a calculator without knowing what you're doing?