for chinese, if you're not capable of recognizing those sounds reliable, it won't just be really hard, it'll be completely impossible. even if every word spoken is one you already know, if your hearing can't distinguish it, then you don't have a chance.