Can’t Hear What Actors Are Saying on TV? It’s Not You
wsj.com
wsj.com
Most modern streaming platforms seem to only offer one accessibility-focused option that combines both, and I find it hugely irritating to see text on-screen like "[SOMBRE MUSIC PLAYS]" or "[CROWD MURMURING]".
There's many Amazon Prime movies I've quit because of a sentence I could not hear very well and they didn't come with close captioning. I hate that so much these days.
My pirate setup at least comes with auto-synced subs for everything I watch.
I've used https://subtitletools.com/merge-subtitles-online before. There's command-line ones, but I can't remember which I've used.
My girlfriend however has a tendency to laugh or react to a line before it's delivered which is REALLY annoying.
I find it frees up the mind. A quick glance at subtitles then your mind is free to analyze other details of the scene. Soundtrack, lighting, mannerisms, costumes, background objects, etc..
I agree it's pretty bad for comedy though.
I get why the accessibility version is nice, but I just want dialogue - I do not need the show's sound described and it actively works against the show.
They don't subtitle it because the audience isn't expected to know what's being said.
I don't remember specific moments from Cabinet of Curiosities but 1899 definitely had some subtitle details that narrowed the plot possibilities.
Frequently, though, subtitles reveal sounds that are impossible to hear from the sound. There might be some inaudible background muttering that I don't even know it's there, but the subtitles tell me what it is, and I'm left wondering where it comes from. Do people watching without subtitles just miss that stuff? Are we supposed to watch everything with high quality headphones to pick up these details?
These slang terms aren't specific for that franchise either, they are common in all things cyberpunk.
It's even more frustrating to know you could get rid of that easily with a simple regexp. There are way too many things that could be great with an extra line of code if only they were programmable.
I was relieved when I read that original article because I really did think it was just me. It really annoys me because when CC is on, my eyes tend to focus on them even if I don't need it for a particular sentence or scene. I feel that takes away from enjoying the film since I'm so laser focused on the CC. I've tried to ease my focus up a bit, but I just can't seem to do it; if CC is on, that's where my eyes go.
I do wonder if a new UI/UX for CC could resolve some of that issue. Maybe something like using AI/ML to dynamically place the CC closest to the person speaking so I don't need to direct my eyes at the bottom of the screen and can have both the text and the actor's face in my field of vision?
Anyways, just some random thoughts from someone who is increasingly annoyed by not being able to make out what the hell people are saying on screen anymore!
> Maybe something like using AI/ML to dynamically place the CC closest to the person speaking so I don't need to direct my eyes at the bottom of the screen and can have both the text and the actor's face in my field of vision?
I think this would be even worse, at least for me. Now not only are there distracting words on the screen, but they're also jumping around erratically!
I wish there was an option to delay closed captions so that they appear after the line is spoken, rather than before. That way, I'd be hearing the line before reading it, rather than the other way around, so it doesn't ruin the delivery. It would also make it easier to ignore captions when I don't need them, because I could just glance to the bottom of the screen after I miss a word rather than having to preemptively read everything just in case.
Delayed CC is definitely an interesting idea!
You can set a video player to delay subs - it's absolutely awful. My spouse prefers having the subs in almost all cases - helps mumbling (talking through their asses as it being called) profoundly.
And from someone who is used to watch with subs for his entire life, you get used to it and won't notice them anymore at some point in time.
I had no trouble with this in the game, but in the show it was very distracting. Probably because in the game I could change where I looked to focus on the text of I wanted to.
That’s what I do with VLC. Just press J (or K I never remember) a few times. Around 1s it’s exactly what you describe. You can then occasionally glance after the delivery if you missed a word.
The actors are jumping around erratically and we track them fine. Even if the text always appears in the same place, it still comes at unpredictable times (temporally erratic). And even normal cc moves around within an area anyway. We track all of those randomizations just fine, without thought or effort.
I don't know until someone tries it, but I can imagine it becoming perfectly natural and someone used to that would find the idea of having to look away to the text maddening. It wouldn't (well, might not) be perceived as jumping around but the opposite, placed already where you are looking.
Even when the text does have to jump from where you are looking, because a new speaker spoke, even that might be better than today, because it draws your attention to the new speaker or i terruption. I often actually get confused by normal cc because all speakers are rendered identically and it's not always clear who said what, and sometimes not even clear that a given string of words is from 3 different speakers. By the time you puzzle it out the whole scene is gone and you're now about to miss some new dialog that's about to disappear before you've started interpreting it.
It would hinge a lot on what they said about getting it right. Surely you could make this idea terrible. But surely it's at least possible to imagine a version that isn't terrible. Different fonts, sizes, colors, placement, borders, etc could all combine to make something far more natural to ingest that what we have now.
Like a better version of comic book speech bubbles. No not literally exactly like them. But some aspects of them, such as how they don't all look identical. Thoughts look different than speech. Yelling looks different than speaking. Emotion and intent are conveyed as well, etc.
An annoyance is that deliberately absolutely-positioned subtitles (e.g., translating onscreen text) are shifted too -- more ideally the feature would only apply to subs without inline margins. Similarly, the time delay from in the sibling thread is undesirable for subs that are timed exactly to what's onscreen, though that's much less programmatically identifiable.
Not sure if it’s related, but I also read a lot in general.
(Fun fact: This only works for me if the subs are in English. If they are in my native language, German, I get really distracted.)
Hah, wouldn’t be able to tell you, the only thing we watched in German in years has been Dark, and there we had English subs so my wife (not a native) would have an easier time ;)
My eyes are also drawn to Japanese subtitles of Hollywood movies when I go the theatre in Japan, and that leads to the same problem. It's a curse.
The only subtitles that I've found useful, albeit still being a distraction most of the time, are the ones in the language that is spoken.
The worst thing is if the the spoken language and the subtitle language are the same, but the subs are incomplete or don't fully represent what is spoken.
But the pirate scene has people dedicated to writing subs, and are often credited in them. There is no reason Hollywood could pay someone to curate their subtitles.
There is because passion will always create a higher quality product than pay.
Subtitles in the pirate scene are good because the person subbing it cares about the source material.
Same reason some commercial versions of classic or rare movies are terrible quality, same reason Seinfeld on Netflix is cropped to 16:9 rather than 4:3.
Yet people in the piracy scene for no pay will take the visuals from a laserdisc version, missing scenes from a dvd, sound and subs from a Blu-ray, fix the subs and then combine it all into a perfect version of a movie. People who actually care put the effort in And the scene polices trash, 16:9 Seinfeld/Simpsons would get deleted from any good private tracker but Netflix/Disney execs are fine with it.
Sort CC by character etc.
Play audio for that particular CC at volume you set, so you pop ear bud in to rehear what exactly was said just before the big fight scene.
Search text for CC for film A, get timestamp for that scene, go to that scene (obviously that functionality you can find other places but might be useful to have inside the CC app)
Free product idea for someone with more time than me.
HDR can help if you’re watching HDR content, which most new content is starting to be.
To be blunt, they are bad grading jobs when delivering a product to a general audience and there's not much getting around that. At least for HOTD it could be reasonably argued it's most egregious episode was simply one where there were significant filming issues at the time due to weather and they had to make the most of it in post (not very successfully, but starting from a bad base), but if we look at the Winterfell scenes from GOT for example that was just someone completely forgetting about average users.
I really don't get why they make this stuff so impossible to watch. Some TVs do have different visual modes ("games", "theatre", "movies"), but nobody ever switches those modes when using the TV for something else. And I only check that mode when things are too dark, and it always turns out it's already on the brightest setting.
Can we just agree that unless the TV is set to "theatre" mode, everything needs to be visible in normal daylight?
That would require:
1. agreeing on what a "normal" amount of daylight is
2. agreeing on the distribution of that daylight (one source vs. many)
3. agreeing on a permissible range of angles the TV must be relative to the light source(s)
4. standardizing which type of ambient light rejection film each TV must use
5. standardizing an average and peak brightness expected from all TV sets
6. standardizing a minimum real (not "dynamic") contrast ratio expected from all TV sets
7. requiring that each TV set sold is calibrated to Rec.709 for SDR and Rec.2020 for HDR
This list is laughable when you examine just how bad a typical "Best Buy™ Black Friday Special!" TV is, even after it has been put through the ringer by a professional ISF calibrator.
Does anyone know if moving to a "3.0" audio setup is sufficient to fix this? That'd be left+right+center channel. Several speakers brands, if I'm not mistaken, do name the center channel as "vocal" or something like that.
Do people with a 3.0 speakers setup or more also have this problem of voices behind harder to discern than they used to?
Or is this just affecting people watching movie using whatever stereo setup?
I'm asking because I've got an "audiophile" stereo setup but don't really want to go to the trouble of moving to an home cinema amp + many speakers.
The problem with your setup (if its build for stereo) is that you will have to replace the amp
You can always set your system to dolby sorround even though you dont have the speakers for it, but what will happen is that you will miss a Channel.
So lets say you are watching 5.1 content over 2 speakers and your amp does not break it down for you, you will be hearing the content of the people speaking weirdly low and all effects REALLY loud.
This is because your tv is trying to send you audio on a speaker you are laking and thus it swallows it. This makes the voices of characters sound further away and can be freaky :D
Saying that if you are receiving a stereo signal - which I expect is the default option - then adding another speaker or changing the amp won’t make any difference, right? Or is there some amp processing technique that improves even a stereo signal?
Its quite a weird feeling if you figure out you did not connect the center speaker after a month, only to realize that "how you could have lived with yourself remains a mistery" :D
One thing that helped a lot was to add 6dB gain to the center channel. Sometimes that is enough, since the voice is usually put on that channel. I became an expert in navigating the menus to change that one volume, then discovered the Android app that makes it easier.
I have a quality 5.1 setup and I have all the problems everyone is talking about.
The mode I usually use for dialog intelligibility is Mch Stereo, which is basically stereo but using four speakers (the front and sides). I think it's only better because the side speakers are closer to your ears than the fronts.
Also, just having it in 5.1 mode and turning up the center channel 6dB or more works as well, and is probably the best sounding solution because you get the surround audio sounding correct.
But I find it annoying to do that because then I want to listen to music and I have to go through the rigmarole of turning the center channel down again.
I think you would get some value out of a 3.0 or 3.1 setup though, because then you could raise the center channel volume, which is where the majority of the dialog audio is.
After watching a hundred hours of Norwegian shows, I now know that "tahk" means "thanks".
Moi, hei = Hi, hello
Moido, heido = Bye
Kiitos, kiitti = Thanks
HTH!
But I know enough German to know that the English subtitles only rarely match the German. So how do people learn English this way?
gat = gun
strapped = armed
five-oh = cop
dime = call on phone
I also once heard that Dutch uses older roots of many words than German, because for many words where Dutch uses an 'i' (like "ieder"), German uses a 'j' ("jeder"), which is a more recent letter.
Dutch is much more in the middle between German and English while those two are at the edges of west Germanic languages, hence the joke
If I turn it up enough for character dialogue to be audible, the 'exploding cars' parts are deafening. And if the exploding cars are tolerable, character dialogue is inaudible.
DVD players used to have a hack typically called 'dynamic range compression' or similar. If I had a professional movie theater, the wild dynamic range would be cool. But in your basement without hifi dampening on your walls, it doesn't behave well :-/
No dig at you, I'm exactly the same. It makes some sense - outside of a conductor introducing the 1812 overture I can't think of a musical scenario that needs to cover everything from a whisper to an actual explosion - but it's still amusing.
Go back and watch a VHS on a CRT TV, or even a DVD version of something that has a Blu-ray or HD version available to stream. It's abysmal, and yet we somehow managed to love them.
After struggling to create single a receiver profile for modern streaming content to cover the range from "everyone's mouth is full of socks" to "pure sonic agony", I do agree that audio mixing has become something of a lost art.
Maybe because when the creators stop being constrained by the medium, they get "creative"?
> Go back and watch a VHS on a CRT TV, or even a DVD version of something that has a Blu-ray or HD version available to stream. It's abysmal, and yet we somehow managed to love them.
Good or bad, at least the full range of colors was used. For example, I've watched tons of Star Trek shows of home-recorded VHS tapes on CRT TV, and I'd still prefer that to watching new Star Trek live action installments in 1080p streaming on a high-quality computer screen, simply because in the VHS/CRT/old shows case, things had colors, and I could actually see what's going on.
All old movies and series had lighted silhouettes in the night or dark scenes. Everyone knew that it means its dark but you could see what is actually going on. Its a movie not a webcam capture. We already fill in the gaps when it comes to the story, we can manage 'unnaturally' lit dark scenes
Maybe we need some software to enhance speech and make it more legible. Not just increase its relative volume but also reduce mumbling. We shouldn't have to, but maybe with an automatic solution streaming services could more easily add the option...
What I would really love would be a way to do that and at the same time turn on subtitles (or captions if subtitles aren't available in your language) for N+10 seconds. A separate button for this would be ideal, but a setting that makes the regular skip backward also do the subtitle thing would be fine too.
Alternatively, I'd be OK instead with a "toggle subtitles" button that toggles between subtitles off and subtitles on (with the language being whatever one was last used).
Edit: s_weber below beat me to the punch here, I had my draft up too long :)
What I'd agree is stupid is if that's the only interface method to get at that feature.
(So it probably is, right?)
One soccer league I watch broadcasts matches in three places: streaming-only, cable-only, and OTA-only.
Streams get the smallest budget ($10k) and have the worst field-level audio, just one mic usually positioned away from the loudest fans and near the benches, which means the coaches and bench players are loud and clear but everything else is muddled. A 20k-attendance sold-out stadium in full-volume cheer sounds hollow. They're also remotely produced with off-site commentators, so the director and audio mixer (who only has the one field mic anyway) don't even know if the crowd is _supposed_ to be loud to the viewing audience.
The OTA-only matches, at 10x or more budget, get mics surrounding the field and behind the goals, mics on field-level cameras, and depending on the venue additional mics in or pointed at the most raucous section. They're also produced on-site with on-site commentators, who modulate their voices along with the crowd noise. More resources and more on-site attention result in a much more dynamic and engaging mix, the director has options to switch to a field-level camera and raise its volume, and so on.
Don't find CC distracting any more, and as an added bonus I am enjoying a lot more foreign content because I'm using CC anyway so why not.
and then you get to experience the phenomenon where you forget that a movie was foreign at all because you knew what everyone was saying just as well as if they were speaking in english
If it was specific to transcription historically, it no longer is today.
It’s a good deal better than other attempts to normalize audio.
I wish I had known that because I really hate my X2400h for it.
The Audyssey auto calibration does make my speakers sound even better but everything else about this AVR is a drag.
It even has a telnet control protocol. It's great.
One thing I really like about it is you can factory reset it to the firmware it came with originally. So I don't get that nervousness when doing updates that it'll be broken or they'll change something that I don't like.
My LG TV, on the other hand, has been blocked from accessing WAN on my router so it doesn't get updates.
Still though I wish there was a button I could press to squeeze the dynamic range of loud movie sound tracks. Often when the explosion sound comes in the whole house shakes. Hard can it be?
how about they take small fraction of the often ridiculous out-of-place special effects budget and put it towards giving us good audio.
like, just because you can do special effects doesn’t mean you need to jam them in literally everywhere to wow us..
i want to be able to watch a movie with my living room theater and have the audio match my system or in my bedroom and have it be clear on basic ass tv speakers.
take some of that stupid special effects budget and give us proper audio tracks.
sorry this is one of my pet peeves. there is no reason in 2022 that audio needs to be this muffled. they can do both theater quality and basic but they dont—drives me up the wall.
For all of my BD/DVD movies, I encoded a second audio track with dynamic range compression, but that doesn't help me with streaming.
My receiver (Denon) doesn't offer DRC, instead it has something it claims is "better" called "dynamic volume" that just means I can't hear any dialog for about ten seconds after an explosion, because it's so slow to respond.
German speaking audiences (where I worked) are used to extreme standards of clarity, to the point where a studio recording quality is what you have to go for. Most German commercial shows and dubs would work just fine as audiobooks. Meanwhile in the US originals there is a litany of mumbling, half words, half sentences spit out, chewed down and all, not only would you have to force actors to do this over here, but everybody would also experience it as bad craft.
Of course this comes from somewhere: recording clean sound on set where the microphones cannot be in plain view is challenging and overdubbing always produces a clean sound if tou don't put in work to change this. Few directors even in Germany are going to make a compromise on set if the sound guy complains (trust me, I have been there and I tried). The German speaking part of Europe as the biggest dubbing market of Europe employs 52% of all voice actors according to wikipedia. But in the end if an audience and a nation of professionals is used to do it a certain way, thay way might persist. US production companies keep getting away with this, so why invest more and risk for getting a sound that doesn't match a audience's expectations?
Also its so dark (pun intended) just use stronger lighting.
Sometimes I feel like the people that work on movies hate movies (or other people) with a passion.
If those high-end audio stream are all available, why aren't they streamed? Or let me rephrase that, where can I get them?
As do Netflix, Apple and Amazon.
Off the top of my head - Northman, just watched it today, great movie, definitely stuff I didn't understand. House of the Dragon. Peripheral. It really feels like every show now.
So not 2.1. 3.1 possibly.