Of course those people might be locally very successful in keeping their people illiterate, poor, miserable, and suppressed for some time. You can find examples of that on most continents. But mostly, that tends to be a highly unstable situation because people don't tolerate being miserable and poor very long and inevitably come into contact with people that can teach them how to fix that. The more miserable they are, the bigger the incentive. That's how revolutions start.
That's how the dark ages ended in Europe. There were still people that knew how to read and write. The Roman empire fizzled out and moved east but it continued to exist. Constantinople was a cultured place for many centuries before it became Istanbul. And that eventually spread west again. What is now Austria and Germany actually used to be called the holy roman empire. Which was a thing that emerged out of the ruins of former actual roman empire after a few centuries of various tribes of Europe rebelling, converting to Christianity, and regaining literacy.
And that's just Europe. The Chinese, Indians, Persians, Arabs, etc. might have a few things to say about their long and interesting history. Europe was a bit of a back water for most of that.