I would argue that it's a disadvantage only from the self-centered perspective that modern society encourages us to cultivate. Empathy is an incredibly useful tool for humans that exist as part of a community, but our societies are structured to benefit those who seek to maximally exploit others, our role models are sociopaths, and the cultural narrative is that our only value is either in being them or being useful to them.