> I feel that even after 10 years I will barely reach conversational fluency in Japanese

Interesting. I feel exact opposite with Mandarin. My progress learning Japanese was incredibly fast, I could speak decently in 6 months and read after 1 year. But I always lose motivation learning Mandarin because it's so hard. Maybe it's because my mother tongue is closely aligned with Japanese in pronounciation and grammar such as conjugation.