I just realized my media key for "skip to next" was double registered by Spotify, so it would always skip the next song and move to the third. It took a few truncated albums to figure that out...