In the human retina, the responses from the 3 types of cone cells (daylight light detectors) are immediately combined into a lightness signal (M + L), and two color signals, “red–green” (L – M) and “yellow–blue” (L + M – S), where {L, M, S} are the long-wavelength-, medium-wavelength-, and short-wavelength-sensitive cone cells, respectively. The basic L/M/S signals never make it past this first level of processing in the eye; all the brain sees are the combined signals.
The perceptual geometry of human color vision therefore has a built-in notion of red, yellow, green, and blue as “unique hues”. There’s a fair amount of variance from person to person, but anyone with trichromatic vision will be able to pick out some particular hue of “blue with no green or red in it”, “green with no blue or yellow in it”, etc.
You’re right that some languages apparently didn’t have any particular need to distinguish blue from green. I could believe that the introduction of blue dyes made this distinction useful. There’s been a lot of study of the topic of color naming, but I’m not sure there’s a definitive answer on that point.