the linked blog is yet another instance of making false inferences from the false assumption of the model working at a letter/symbol level. it cannot see letters. it cannot see the 1 or 0 in 11010 either. (note that a request to simply reverse a word would illustrate this usually, but some glue code has been added to do it)