It would be a lengthy business to mention all the different people who have spent their lives engaged in chess-playing or exercise with ball or the practice of roasting their bodies in the sun. They are not unoccupied when their pleasure form such a busy occupation. No one will doubt that those men are energetic triflers who devote their hours to the study of useless literature - On the Shortness of Life
That said, you are right:
https://la.wikisource.org/wiki/De_brevitate_vitae
> XIII 1. Persequi singulos longum est, quorum aut latrunculi aut pila aut excoquendi in sole corporis cura consumpsere vitam. Non sunt otiosi, quorum voluptates multum negotii habent. Nam de illis nemo dubitabit, quin operose nihil agant, qui litterarum inutilium studiis detinentur, quae iam apud Romanos quoque magna manus est.
(emphasis mine)
I find it far more distracting to find a modern term in an ancient text that I know the author couldn't have known about. It's jarring and anachronistic. I would much rather see the original term. I can make a decision about whether to spend a minute to look it up (and learn something!) or skim over it if the meaning is clear enough.
[0] https://classicalwisdom.substack.com/p/should-we-update-old-...
Plus, I doubt most people would really agree with de brevitate vitae. It's the equivalent of "grind culture" but from the first century. Amusing and interesting but probably not congruent with now most people want to spend their lives. (No shame from me if you do want to live your life that way, but it should just be known that this is far from a neutral perspective.) For a more balanced view of otium (pleasure, relaxation, opposite of negotium, business), I'd recommend the letters of Pliny the Younger.
The translation my book used instead of "chess-playing" was "draughts."