419 karma · joined October 20, 2020
https://github.com/soundshader/soundshader.github.io/tree/ma...
I suggest to call this field of science "birdographics" and its researchers "birdographers".
https://github.com/soundshader/soundshader.github.io/tree/ma...
If his solution doesn't work with arbitrary number-like objects (matrices at the very least), doesn't support voice input, can't send results via email and can't seamlessy resume the calculations after a hardware failure, it's far from overengineered.
On the other hand, 440 Hz seems just a random number to me picked by someone with little imagination.
1. Time progresses from the center to the edge of the circle.
2. Color means note, e.g. A4=432Hz is red, but so is A1, A2 and all other A notes. B is orange, C is yellow, D is green and so on.
3. The amount of fine details is frequency: the higher the frequency, the more fine details you see. If notes of different colors and different frequencies sound simultaneously, e.g. a A2 with a G5, you’ll see a red belt with a few repetitions mixed with a blue belt with 8x more repetitions, so the result will be a purple belt with a fine structure.
For example, on one image below there is a green belt with 10 repetitions. One repetition correponds to 13.5 Hz here (55296 Hz sample rate, 4096 FFT bins), so 10 repetitions is 135 Hz, which corresponds to C3. On another image there is a curious red cross in the center, it’s a red belt with 2 repetitons. That’s 27 Hz, or A0, almost infrasound.
https://soundshader.github.io/?n=4096&img=2048&acf.lr=5&sr=5...
I used the meow sounds from https://soundspunos.com/animals/10-cat-meow-sounds.html. I expected to see very little variability in the meows, maybe just 4-5 different types for basic emotions. To my surprise, each “cat meow” has astonishingly colorful, complex and unique structure, unlike human vowels that follow a more or less predictable pattern: https://soundshader.github.io/vowels.
The algorithm behind these images is fairly simple. It computes FFT to decompose the sound into a set of A·cos(2πwt+φ) waves and drops the phase φ to align all cos waves together. This is known as the auto-correlation function (ACF). Before merging them back, it colorizes each wave using its frequency w: the A notes (432·2ⁿ Hz) become red, C notes - green, E notes - blue, and so on. Finally, it merges the colored and aligned cos waves back, using the amplitude A for color opacity, and renders them in polar coordinates, where the radial coordinate is time.
This post is a natural extension of that idea. I've been thinking how to introduce colors into ACF images. ACF splits a waveform into a set of pure cosine waves and aligns them together by removing the phase. The idea is to color each cosine wave with the note it corresponds to, so when these waves are aligned, not only the amplitudes of the waves add up, but also their colors.
"Absolutely direct experience of the will is impossible, because it will always be mediated by time, but in first-personal experience of volition and the experience of music the thing in itself is no longer veiled by our other forms of cognitive conditioning."
A relevant off-topic: there is a living "meta material" called planarian[1].