On my MBP M2 Max 16" with 92GB of RAM, 2 prompts on llama3.3:70b or 1 prompt on deepseek-r1:70b take about 10% of battery. Really makes me nervous when I think about people (ab)using gpt-o1 or 4o for everything.

For a prompt to make the cut, I usually judge whether the task (or the documentation) is boring enough, time-consuming enough, yet precise enough for an llm to give me the solution. If something requires more than three-five prompts then I need to work on it myself and come back with smaller and more precise questions.

IMO, if the green energy industry wants to penetrate an important domain of modern life fast, the serving of open source models seems like a really low hanging fruit.