P.S. However, if the API includes CoT tokens in the total token count (in API responses), I guess it's OK.
Is it actually different from paying a contractor to do some work for you on an hourly basis, and them then having to "think more" and thus spend more hours on problem A than probably B?
this completely rules out any form of negotiation for anything, ever
It merely rules out pulling prices out of thin air. Which is what OpenAI is doing here, charging for an arbitrary amount of completely invisible tokens. The shady part is that you don't know how much of these hidden tokens you would use before you actually use them, thus making it possible to arbitrarily charge some customers different amounts whenever OpenAI feels like it.
There's no problem if a specific sum is negotiated beforehand. Doesn't OpenAI bill at the end of the month post factum?