We humans? More 'we computer programmers'. The model 'humans' have more closely follows CIE (
http://en.wikipedia.org/wiki/Color_model#CIE_XYZ_color_space).
If, instead of measuring it, you asked naive subjects (probing for what they are conscious of), you might even get answers where red and violet are highly separated (as in a rainbow), but I think you can make them question that model easily by creating a palette going from red to violet that does not include orange, yellow, green, or blue.
In either case, the problem remains that humans perceive colors that do not physically exist, such as brown (aka 'dark orange-ish') and gray (aka 'shades of white')
Historically, some people would have known about mixing paints. That might have change their ideas about color, but that isn't RGB, either.
Finally, I am not sure one's color space will change with the addition of types of cone cells (it is cones, not rods that are color-sensitive. It alliterates: kones are for kolor).