Yes, there was even a <bgsound> HTML tag to play MIDI files, which was heavily used in places like Geocities.