macOS I assume? I use a little app called noTunes (it's on github) to prevent that from happening.

edit: should be this one: https://github.com/tombonez/noTunes