As a native Korean speaker, learning Russian was probably the most difficult experience. I still can't figure out the proper accents. I also don't know enough about linguistics to understand why it's so difficult.
In contrast, learning English and Spanish were trivial in comparison.