That section is not really what the paper is about at all, though.
The examples they give of (what they think is) FER in LLMs (GPT-3 and GPT-4o) are most informative to a layman and most representative of what is said to be the core issue, I'd say. For instance:
User: I have 3 pencils, 2 pens, and 4 erasers. How many things do I have?
GPT-3: You have 9 things. [correct in 3 out of 3 trials]
User: I have 3 chickens, 2 ducks, and 4 geese. How many things do I have?
GPT-3: You have 10 animals total. [incorrect in 3 out of 3 trials]