What you describe is the entrance to their esophagus. That's why although the kayaker found himself in whale's mouth, the animal could not swallow him and had to spit him out.
But it's not true of all types of whale - Toothed Wales (such as Beaked Whales and Sperm Whales) are apex predators which much larger throats allowing them to eat larger prey.