Yes stick to medicine. Psychology is in the puffy science zone (social science). Medicine is the oldest practice and I'm happy to see it being rewarded.
That said, social sciences are integral to understanding how this world works and how we can improve, and are in no way inferior to "pure/traditional" sciences.