The way I have seen this “measured” is by asking (demanding) people to pull some “time saved” number out of their ass. That number is then taken as fact, without question. So the measurable productivity gains are all based on coerced people making things up, omitting instances of the LLM tools slowing things down. It’s a house of cards, and it’s going to fall after a few more months of empty promises without results. “You claimed 300% more productivity, but delivered the same amount of work, and took on this massive AI bill. What the fuck are you doing?”
LLMs are cool, but they aren’t magic. This shit is exhausting, just skip to the part where you fire a bunch a software engineers, because that’s clearly what you actually want to do :/