I'm somewhat convinced the only reason other layouts are easier to learn touch typing is because most keyboards are in qwerty. Learning to type well is still hard. In fact if you typed well already and decided to switch layouts I believe you'll have a much easier time than a newbie.

I learned Colemak earlier this year. After I reached my old qwerty speed I re-learned how to type in Qwerty. As such I can now type in both layouts at my original speed. Typing in qwerty is really not bad; good enough that I don't really recommend others to change layouts or learn another one. I am also convinced an opinion stating that qwerty is terrible coming from someone who still can't type in it well and naturally is somewhat biased.