2 and 3 are, but that's about where it ends. Yeah you can do subdivisions of 5 and 7 but it starts to be an academic exercise at that point. So, no, prime numbers don't have any special relationship to music, sorry. Factors of 12 and 16 are actually the most common and useful groupings in most music that people can dance to.