I had the exact same experience, but if I pictured pressing them in my mind's eye, I realized what they did.

It reminds me of some bilingual kids I know that can understand their dad's language perfectly, but they have a really hard time speaking it (since they always reply in their mom's language). You only learn what you practice.