Did you set this up manually? I'm not using Spotify but this sounds rather confusing. Is it at least smart enough to recognize when there's something else playing on your computer and send the skip command to that app instead of your phone if you hit the skip key?