Yes, it's entirely normal in Germany to just walk in and consult a pharmacist about minor problems. They're generally quite friendly and not too busy, even in the middle of Berlin.
Like Berlin, they also seem to be a pretty underutilized resource.
That's also why it's important to always go to the same pharmacy if you can. If you switch to a new one, make sure to switch all your prescriptions at the same time.