Did you ever learn another language? It's impossible without memorizing a massive amount of things, especially when the writing system is different than the one one is familiar with. In fact the most famous researcher in vocabulary learning (Paul Nation) states in one of his book that rote learning is one of the most efficient use of time.
I'm of the reverse opinion that memorizing things is a "secret trick" particularly effective, that is put aside by a lot of people because it takes effort.