You seem pretty certain for having only the most rudimentary understanding.

I’m still going to have to disagree. I’d describe the idea that token granularity is the cause of letter counting limitations as a hypothesis, not as something that’s been conclusively shown as far as I’m aware.

I’m not discounting it, or even saying it’s unlikely, but its not hard to imagine other ways it could plausibly be happening.

As a side note when I mentioned training data I was not suggesting anything related to “token metadata”, or to tokens in any regard. Rather, I think it might be possible to instead improve the learning around certain types of counting in a way that could generalize.