LLMs basically are examples of how humans visualize things. With a few differences. Humans have more fine grained control over the result and understanding of a query. LLMs have greater detail in the sense that the LLMs knows the location of every wrinkle on a face while our imagination delivers an approximation with detail only being rendered if we decide to focus on the details.
The thing I never got with the "Close your eyes, can you visualize a Red Star" - is that I can "conceive" what a red-star is like but I can't even imagine what "visualizing" a red star would be - do people actually see the red star in their head in the same way that I'm hearing Hell's Bells in my head? Or are there people who can actually pick up the actual image in exactly the same way they hear a sound? (I'm presuming not)
There is zero difficulty in my mind distinguishing between the sound I hear and the sound in my "head" - but at least I have an ability to hear sounds.
On the flip side while I have absolutely no ability to view images in my head 99.9% of the time, about 0.1% of the time, usually just in the 5 or so minutes before I fall asleep - I do see thinks in my head - to the point of being fascinated by them - but in this case - I'm actually seeing things, even though I have no control over it. It's different from when I'm hearing things - because that is mentally hearing things, whereas when I'm seeing things as I fall asleep - it's not mental at all - I actually see them (albeit with my eyes closed). It's a real image - not a mental one.
You are the first person to have given me a sense of what it means to "visualize" if it means something similar to "hearing" a song in your head.
It's also different from the inner monologue, btw. That's identical to my ability to hear sounds. Clearly there. Clearly mental. Sometimes chatty to the point of being distracting - but there is no doubt whatsoever that it's a mental dialogue - nothing whatsoever like actual sounds.
The imagination spectrum applies to all senses, so we all have varying degrees of it. Some can visualize every sense very well, others only vague faint unclear versions, some a mix!
I can recall/imagine taste, smell, vision, hearing, touch (texture and temperature), body movement, spacial awareness, and maybe more.
I can vividly imagine doing a physical feat, all the imaginary senses and sensations. Same as hearing a song in my head or imagining a red star.
It follows that there are others who can't imagine the other senses. What super imaginary powers might someone else have that is equally beyond my own? I heard of a guy with synesthesia who imagined numbers as complex 3d shapes and he could multiply large numbers in his head by, lego style, combining the shapes. The mind is wild.
I think the initial stimulus can originate at any part of this circuit.
So I do not think there is much difference between external so-called real stimuli and internal ones.
it's all just vibrations, processing, and reverberations :)
I'm the same way and my impression is that, no, most people don't have an auditory imagination anywhere near that strong. I actually work hard to avoid songs that are notoriously catchy and annoying because I know I won't get the earworm out of my head if it gets in.
I basically always have a loop of music playing in my head. Which piece of song is stuck playing in a loop varies over time, but it's very rarely silence. Often, it will be a sort of jumble of a couple of different things. (Right now it's a line from some annoying meme song my daughter just sang and a bit of the bassline from Basement Jaxx's "Red Alert".)
I'll often wake up with a different song stuck in my head because there's music in my dreams too.
> about 0.1% of the time, usually just in the 5 or so minutes before I fall asleep - I do see thinks in my head - to the point of being fascinated by them - but in this case - I'm actually seeing things, even though I have no control over it.
This is called a "hypnagogic hallucination" and is pretty common for all people to experience.
I can't really see objects in my head, but music I can play perfectly like it's an iPod. Usually just gets stuck on one track all day, though.
Another fun story. I did improv comedy for a few years. One of the warm up games we played was someone would start singing a song, then another person would tag you out and sing a different song. I was bad at this game. But I have a few simple things in my back pocket to "play". Somewhere over the rainbow is one of them. The last person was doing some sort of rap, and what came out from me was a rap version, until the crowd helped correct it. I just have no idea what it sounds like other than trying to memorize if it's a high pitch or a low pitch, etc.
Regarding the inner monologue, I do have one. And it feels similar to my ability to visualize. I can control it, give it emotion per say, (not sound for me), but it isn't as strong as a memory of a dream.
I can hum Jingle Bells (or 1000+ other songs, the Star Spangled Banner, Rudolf the Red Nosed Reindeer, any pop song from the last few decades, etc...). The experience of imagining the song is the same as humming it except I don't actually hum it.
It sounds like you're saying you can't hum a song or even remember one? Can't remember anyone's voice? Can't rememeber the sound of fireworks? Of cars going by?
I can’t hum songs anymore complicated than the “Happy Birthday” song (but if it plays, I’ll recognize it).
I can’t remember people’s voices in my head (but if I hear them speaking, I’ll recognize it is them).
The bang of a fireworks or a car going by is simple enough to recall. It is also generic. I might not remember the hum of the engine of a specific car, or be able to play back a specific fireworks display.
Explains why I had such difficulty singing my whole life. It must be way easier if you can just recall a song in your head and match its pitch!
Like the idea of a firework bang, being low intense vibrations, or a car horn being a high pitched short startling sound. Still can't really imagine it like I can picture things in my head, but I have an idea of the what the experience would be like.
Yes, that's a very good description of what the experience is like.
When you're auralizing(?) a song, you can choose which memory of the song you're listening to, and you can tap along with the beat, whistle along with the melody, sing along with the words, while being absolutely conscious of the fact that you're not actually hearing the song, right?
Visualizing something is the same, you can manipulate the image in your mind, rotate, choose different memories of the thing - or imagine new ways the thing could look, while being absolutely conscious of the fact that you're not actually seeing the thing in front of you.
When you said "red star", I imagined a red giant star, protuberances and sunspots and all, floating in space. Then someone else commented about a "five-pointed star", so I shifted my imaginary image to a stylized five-pointed red star icon instead. Same as you would imagine listening to one song, and then swapping to a completely different one with the same title.
To the rest of your comment, it's fascinating how it's all a spectrum. I can't visualize a star, can hear sounds but have no inner monologue.
If I put my hand a couple inches away from my face, in front of one eye only, I can still 'see' aspects of that hand with the uncovered eye.
Analogously, when I imagine a 'red star', it is visible in a different medium / realm (like my covered eye) than the rest of the things I see around me (with my uncovered eye). I can 'insist on' or 'overlay' the imagined image, like the red star situated in a particular spot on my desk, but I do not feel that they 'become the same visual stream', ever, such that I would think that the star could be physically present in the room.
I've recently been wondering about the fact that I am pretty sensitive to sounds and may have trouble concentrating in a very noisy environment (especially if the sounds are not constant/predictable.)
My hypothesis is that this inability to concentrate well in a noisy environment is a trait that mostly affects people who are more 'auditory'. Thoughts/experiences?
(I don't mean to be dismissive; I do think this is an awesome topic to debate and talk about though, it's a great path for us to maybe understand qualia a bit deeper, if that's possible at all.)
Ask me about it while dreaming and it’s a full on 3D movie/VR experience.
Music too I can play that in my head no problem like my own radio (unless it has words then I can’t imagine it at all) - so I suck at karaoke. Even trying to sing with songs I can’t process it correctly unless it’s tonal sounds from the words.
For a neuroscience background we are certainly not all wired the same. You are correct though that aligning those descriptions and untangling social meanings and words from experience is tricky.
Uhhhhhhhh.......I don't think that's extreme at all. Isn't that normal?? I just asked several people today to close their eyes and imagine an apple (or anything else) and everyone just sees black.
If you could see objects with your eyes closed, I think that's called having a photographic memory? (Which is...rare?)
I can have very vivid mental imagery, I can imagine all sorts of fantastical things in detail in my mind on command. But that doesn't mean I don't see black when I close my eyes. It doesn't mean the mental imagery blocks what I can see normally with my eyes open. It is in your "mind's eye", so it is still triggering the vision parts of the brain, but almost like its on a different screen.
Similarly with imagining sound or music. I can almost perfectly recall some of my favorite music, I can compose a new piece (poorly) in my head based on music and sounds I have heard, but none of it will drown out an actual sound I hear around me.
That being said, if I am very mentally focused on some mental imagery it can still distract me from my real vision and or even sort of "replace it" without my closing my eyes. Sort of like the feeling you get when driving and zoning out thinking about something (but you are still safely driving).
But when I close my eyes I describe it best as a black-and-orange static. I'll occasionally get residual images. Ask me to describe something in detail I struggle - but I can conceptually describe a space for example.
These are very different to what I "see" when I meditate for example, which is more dream-like (and I assume similar processes kicking in)
But maybe I have aphantasia and am totally wrong!
All I'm saying is plenty of people can play back songs in their head, or replay a conversation (or practice a future one) - it's why having a song stuck in your head is a universal experience - but not be able to internally "view" or "picture" objects with anywhere near similar fidelity, and therfore being good with sounds but bad with imagery is quite common, and not indicative of a condition (which is being called "aphantasia" here.)
I have very poor ability to imagine/remember music. Though curiously I'm good at "intros" (guessing songs from the first few notes); I couldn't hum you the first few notes of anything.
My visual imagination absolutely can have a time dimension just like my audio imagination. I can remember sequences of film from movies I have seen many times with high level of detail, and then if I so choose change what happens in that sequence to whatever I want.
I think it's more that as humans our audio fidelity in general is less detailed than our visual fidelity so it is easier for us to notice limitations in our ability to imagine visuals than in our ability to imagine audio.
And so many things I read about aphantasia are spot-on aligned with my own experience, but put into a comparative context I hadn't really thought about until the word was more or less invented a decade ago, and the idea leaked out into the internet. The line about "weaker autobiographical memories" in this article really hit home for me. I take so many photos now - thank goodness for digital photography - and in the context of this topic, it's no wonder.
I've also struggled to remember dreams, all my life - and also thought the 'counting sheep' thing never made sense, at all.
I can’t imagine/see mental images the same as having a real screen in front of me.
I can imagine a triangle. I can’t “see” it, it has no color and no brightness/darkness. Can’t really even describe the size. More like feeling around in a dark room. But the triangle is gone the instant I stop thinking about it. I wouldn’t be able to imagine a game of Tic Tac Toe.
Some people call this normal, some don’t. I have no idea.
I can imagine music too — and find it takes far less effort. (But can’t remember exactly what I imagined — more like just enjoying as it happens)
It looks roughly like the detail level of picture "C" in this picture: https://history.siggraph.org/wp-content/uploads/2023/02/2014... But with much less brightness/opacity/solidity than that, maybe 20x less (i.e., only 5% of the brightness/opacity/solidity of the tie fighter image - but same level of lack of detail)
You can improve this ability through practice. If you spend 10 minutes every day concentrating on visualizing that triangle with more detail & specificity, like an art student would, you'll gradually improve.
I have it, but could draw pretty well when younger (not practiced in decades). What I found, though, was that my style was very different depending on if I drew from a model or from memory.
People with aphantasia are absolutely crap though with drawing anything from memory, but they can draw if something is in front of them.
Mine are clearer than picture "C" though when I try to focus on something they tend to fade to black. Sometimes though I have dreams in HD where when I focus on something the details reveal themselves and everything is clear and sharp.
I often get really detailed mental imagery. Often unbidden, when daydreaming. My drawing skills are ok too.
When I partner with my brother it's almost telepathy. I can draw a single curved line and he'll correctly guess 'elephant' before any players have even put pencil to paper.
If so do you see things in these dreams?
Either way, I've experienced a range, where my normal day to day experience is no sign whatsoever of seeing anything except maybe occasionally sub-second vague flashes, and the best I've experienced was as if I was looking straight at a real scene. So my day to day experience stands out very, very starkly against both my regular dreams and that one experience.
The frustrating part about that experience is that it suggests I can see things in the right frame of mind, but I don't know how to bring it out.
I suspect the mind is just like a body in the sense that the more you engage a particular muscle the easier it gets.
When I’m struggling with something I find it helpful to reframe statements into questions to activate creativity and clear any unconscious barriers that the mind is enforcing.