yes, "get under your skin" can mean that, it can mean "can't stop thinking about" like the way somebody annoys you while it turns out you are falling in love