As a native speaker of portuguese, which uses the exact same two words, I can't think of any exceptions.
I don't see why this would be a "strange" and "random" language quirk when it makes perfect sense in practice. The only situations I can see where it wouldn't make perfect sense would be in situations where you're translating to English, which is not a productive way to think about languages.