Bird song sonographs show distinct drawing patterns
soundshader.github.io
soundshader.github.io
So any sweeping statement like "birds don’t seem to bother to create a complex multi-layered harmonics pattern" is practically guaranteed to be wrong. And so it is. Lots and lots of birds sing incredibly harmonically complex songs. Browse any of these (https://www.remoteenvironmentalassessmentlaboratory.com/expl...) if you're interested - it's a tiny sample of birds, and many, many of them do in fact have harmonically complex songs.
"Harmonics" here isn't referring to the harmonic complexity of songs.
It's referring to harmonics as in overtones, the complexity of the overtones -- the timbre.
It's the voice of the bird, not the songs it sings.
I agree that the point TFA is suggesting seems to be about the spectral complexity at any given moment in song - what you might call the timbre - and how nearly pure the tones in their spectrograms are. (They don't specify what species they're showing. Looks like several, but I can't ID them by eye.)
My point is that no, in fact, many bird species produce vocalizations that are indeed spectrally complex (beyond even just harmonic stacks) from moment-to-moment.
Take a look at song from a blue jay (https://www.remoteenvironmentalassessmentlaboratory.com/expl... ; not the best example, or one I produced, but an easy one to hand), particularly the syllables near the end of the clip. That's an example of a complex timbre.
And lots of species produce song and calls with features like this.
Compare a parrot or a crow vocalizing. From that it seems some can control the amount of overtone or at least can use two different modes or something.
Seems almost like comparing humans whistling vs speaking or something (assuming whistling is closer to a pure sine tone).
And it's great that you bring up the possibility that two modes might be engaged. The avian vocal organ, the syrinx, has two sets of membranes which can vibrate as air is passed over them. Many species (particularly, as you'd expect, the ones best at imitation, like corvids, parrots, lyrebirds, etc) are able to control these two sources independently (but even those which generally don't control them separately can produce syllables with rich timbre), layering a harmonic stack with a click or a buzz.
I feel I should reiterate: nothing here is meant to detract from TFA's demonstration of what looks like a nice acoustic analysis tool. But TFA is, unfortunately, just plain wrong in its conclusion that birdsong is mostly pure tones.
Also, couldn’t harmonics be used to improve decoding in noisy environments? Spreading the signal over a wide band is not unheard of in man-made electromagnetic communication either.
1. Do we appreciate bird songs because they indicate a resource rich/hospitable environment?
2. Do birds hear the entire range of the song, or just pick up specific bands?
For a loud, high-pitched sound produced from a tiny object like a bird, is it even physically possible to have the loud resonances needed for overtones and timbre? I think it's just physics.
Whales are "signaling" over huge distances too but have plenty of overtones, since that's what low frequencies in huge cavities produce.
I'm not sure the dichotomy between "aesthetics" and "signaling" you suggest actually exists. A peacock's plumage is certainly aesthetics but also certainly signaling. And what is a birdsong's melody if not aesthetics?
The resonance of the flute's air chamber is driven by the noise of forced air stream, which is why it contains high frequencies at all. Of course you can't recreate the flute sound just with some periodic sinusoidals, because the noise component has to be present. The noise is complex and is itself filtered by the flute's chamber, in a different way depending on which valves are closed. You can play a recognizeable scale on a flute without getting a tone out of it, just using air noise, the same way you can produce a musical tune using chhhh sounds out your mouth. Those notes, or something like them, are still there in the background when a tone is being produced. There is no flute tone without them.
It was a pretty awesome device.
It's a feature
https://monoskop.org/images/a/af/Gough_C_2007_The_violin_Chl...
What does this mean?
"These sonograms are remarkably different from other sounds, as if birds “draw” with sound something that’s flying backwards in time."
Basically, all sounds that you hear are composed of many layered sine waves of different frequencies and intensities. The graphs in the post are spectrograms, which graph those frequencies over time. The Y axis represents pitch, the X axis represents time, and the brightness at any given point represents how loud that particular frequency was at that particular time.
Most sounds, even seemingly simple ones, look very complex on a sonogram, like a smudged pen stroke. The images of different instruments below demonstrate this; these are all very complex sounds, even though we only hear it as a single note being played. The voice one is one of my favorites, because it shows just how weird and complicated everyday sounds can get.
But bird songs are different; on a sonogram, they appear as a single line. The complexity of the bird songs here comes from the fact that they're taking a single sine wave and changing the pitch over time. Where most sounds look like a complex mix of smudged paint strokes, bird songs look like a single, precise, bouncing stroke.
https://www.xeno-canto.org/species/Dromaius-novaehollandiae?...
Are birds sending specific data packets eg weather, food prospecting geocoordinates? Or are they entertainers like Frank Sinatra or Dolly Parton?
And could we decipher the language by studying data in context eg food hunts, mating rituals, predator warnings?
What might Claude Shannon make of these spectrograms?
Which is akin to dragging a single finger across different piano keys. Only a single frequency, or note, played at a time. This is common among songbirds.
Contrast that with the sound of a crow. The sonogram is much more broadband in signature. This is akin to mashing a bunch of keys on a piano all at the same time. Many frequencies present at simultaneously.
Crows, in the morning, seem to be broadcasting work gang related information, organising their crew to go and harvest certain regions, then report back on the yield.
If songbirds are courting, and hence broadcasting different information, for different purposes, I wonder if some generalisable differences might be apparent in the receiving birds brains.
I think there's a key difference.
Assuming this is the spectrogram of single note being played on the Piano (https://soundshader.github.io/hss/gallery/piano/2.jpg) (which I can't be certain of, since the audio sample wasn't provided). Seems like a single piano note fires on multiple frequencies, and our ear 'aggregates' them so we hear it as a single note.
Songbird belts out a single frequency at each point in time. We still hear a single note but there's nothing to aggregate.
At least that's my interpretation of the parent comments. Again, can't be sure.
The short of it is that most natural sounds product a root tone plus a varying amount of related tones above it. Our ears hear the root tone, and the other tones above it are what give the sound its uniqueness. That's why a guitar, a clarinet and 3 singers can produce the same note while sounding distinct.
Birds seem to produce a natural sound without a lot of the related tones above it. Their sound is, relatively speaking, much purer than most other natural sounds. That's very unique.
Apparently I'm pretty far off, but just this idea of animals communicating images with sound waves was something I'd otherwise never have.
Perhaps it's good to know that the x axis (from left to right) is temporal. So for someone/something to translate this to an image with some special sense would also necessitate some memory part.
With a big fantasy you could continue your hypothesis by comparing it to describing an object you see with words by telling the height of the outline from left to right.
Some people see colors or feel tastes... and it doesn't seem that unlikely that there would be selection pressure for parts of the bird brain to connect their spatial awareness to their auditory system and then songs. There could be a nice feedback loop that their own songs would strike similar experiences for themselves (if they hear themselves similar to others).
Of course we know that bats have this type of neural connection in echolocation and dolphins/whales may even using it to communicate in similar ways with their songs.
If you place migratory birds in a big round cage, they show 'Zugunruhe[0]', or migratory restlessness: they jump and flutter in the direction that they would be otherwise be migrating if they were out in the wild. Rotating the magnetic field (e.g., by putting magnets around the aviary) also rotates the direction of their Zugunruhe.
No one totally understands how this works, but the magnetic information is thought to be 'overlaid' on other sensory information. One candidate pathway involves a light-dependent pathway in the retina. When a cryptochrome absorbs light, it generates radical pairs that affect how visual information is perceived[1]. This could give the birds something like HUD which displays magnetic field lines on top of the visual scene. Consistent with this idea, birds can only orient to magnetic fields under certain colors of light, with the color varying a bit from bird to bird[2]. It's almost as if the colored light washes out the HUD.
There's another parallel pathway involving bits of magnetite in the beak[3,4]. These signals flow through the trigeminal nerve, which carries a lot of different signals; it would not be impossible for this to manifest as "pressure", as it carries touch/somatosensory information in many animals.
[0] Ethologists love German and this word captures my lockdown feeling so very well. [1] https://www.sciencedirect.com/science/article/pii/S000634950... [2] https://www.nature.com/articles/364525a0 [3] https://www.sciencedirect.com/science/article/pii/S000634950... [4] https://royalsocietypublishing.org/doi/10.1098/rspb.2009.005...
Thanks!
Edit: Seems I can not remove it by myself :-(
> Contrary to what you might think, our ears don't seem to rely on an FFT-like process to extract isolated frequencies. Instead, our ears detect periodic parts in the signal, although in most cases those periodic parts closely match the FFT frequencies. There is a simple experiment that proves this point:
https://github.com/soundshader/soundshader.github.io#why-acf...
Put in earbuds or a headset and (quietly) play sounds that are slightly different in frequency (1-10hz).
You will still hear a sort of ethereal beat tone between them that's different than the beat you would hear if you were listening to the same through speakers. I don't see how this would occur frequency-domain perception and it's too present (at least in my experiment) to be attributed to bone conduction across the skull.
I wish I understood some of the neurological explanation of how the beats are perceived because it doesn't seem to match with my understanding of the explanation of how our ears work. If everything is pushed into the frequency domain based on the stimulation of different parts of the cochlea, where does the time domain beat emerge?
There’s another component at play too: beat frequencies. This happens anytime you have different frequencies playing simultaneously. This is a result of simple waveform interference. Lots of examples, but I’ll never pass up a chance to link to Julius Sumner Miller[0]: https://youtu.be/7dxkW5bsUgs
So the brain is doing lots of work to integrate the stereo “image,” in much the same way we can wear 3D glasses and perceive depth[1]. Binaural beats reduce things down to a more fundamental level: you’re playing with how your mind integrates the stereo field in a weird way, and it produces a beat frequency that does not exist in the pulsed air. This may be learned behavior.
[0] I’m eagerly waiting for some music producer to sample this video: “all the music fell out”, “we should have this mechanism called beats”, “beats: wonderful!”, etc.
[1] I wonder what the effect of rapidly switching the left/right components of a stereo image would be. Probably nausea.
If the cochlea is effectively taste buds for sound, the only thing the brain is going to get is which part of the cochlea is being tickled. There's no time domain information there, just some ambiguous 'pitch'.
If that's the case though, how does the brain know to synthesize the 4Hz differential between these two frequencies. The 432Hz and the 428Hz aren't making it to the brain, just the fact both ears are getting tickled in very close but different places.
(Also my dad absolutely LOVED watching JSM and would always call us into the room any time he was doing one of his crazy experiments on TV. I agree his stuff is very 'sampleable'
Edit: Just watched the video, it's actually a gold mine for hip hop lol. Just play this in the background and scrub around his videos - https://www.youtube.com/watch?v=JVISRjhXzzM
good thing it's friday (may need to fix volume) - http://www.youtubemultiplier.com/6095af3ba32b6-jsm-on-beats-...)
Looks like you know more than me about how our brains process audio. I was running on the assumption that some kind of frequency analysis made it to our higher processing centers, is that not the case? Given that what we hear all the time is incredibly chaotic (multiple pitches that we hear as chords, lyrics vs the rest of the music, focusing on one person speaking, etc) I thought we must at least be running some kind of internal spectrum analyzer and continuously comparing new input to previous averages or something.
There almost has to be a clock-like reference construct somewhere, right? The ability of some people to perceive perfect pitch points to it IMO.
The hair cells in our cochlea function essentially as a great big FFT -- this is well-established -- and so our source neural input begins with that. The brain doesn't have access to the underlying waveform at all, as far as I'm aware. It is incredibly sensitive to the timing from each ear though (just as FFT includes phase information).
You can read all about what we do know here:
https://en.wikipedia.org/wiki/Neuronal_encoding_of_sound
Our brain does perform advanced signal processing to condense sets of overtones into a single fundamental frequency, which even works in the case of a "missing fundamental", and binaural beats are conceivably explained by this mechanism. Though it could be a different mechanism at work as well, related to how we process audio spatially.
The hair cells in our inner ear are activated in response to specific frequencies, virtually identical to how an FFT operates.
There is then further processing attached to that, in the same way that we perceive colors rather than cones directly in our vision. With audio, we need to collapse entire series of overtones into a fundamental frequency with a timbre (color).
And specifically in the experiment linked, it's showing how the ear intelligently restores the missing fundamental.
But I don't believe there's any biological/neurological evidence to support that the ear detects periodic repetitions of an overall waveform, and that this explains the missing fundamental. To the contrary, how our hearing works biologically suggests that we are indeed performing something like FFT, but then applying sophisticated pattern recognition on it -- on the "FFT", not on the waveform.
In the process of recording, it will show you the bird's spectrograms, which is really cool!
I think the rule for audio papers is linear change in color according to energy?
So this rep may lead us to hallucinate our conclusions?