An amusing version of this happened to me in Porto recently at a bookshop. Many moons ago I was fluent in Brazilian Portuguese, but today that's retained mostly in reading, I can't speak well nor can I easily follow European Portuguese speakers. I was browsing the Portuguese literature section when the shop keeper asked me question (which I didn't catch), and then upon ascertaining I spoke English she rather forcefully explained where the English section was, but very confusedly watched as I politely kept where I was. To make matters probably more confusing I ended up buying a linguistically avant-garde book that I soon learned really is best suited for native speakers (Guimarães Rosa, the author, is basically a Brazilian James Joyce)