It's already a race to the bottom.

Deepseek v2 lite is a damn good model that runs on old hardware already (but its slow).

In 2-3 years we will likely have hardware that runs 70b parameter models with enough speed that you will run it locally.

Only when you have difficult questions will you actually pay.

For example I already use https://cluttr.ai to index my screen shots and it costs me $0.

(I made this tool tho)