I'm Swedish too, and grew up with the same understanding as the parent poster. Only in recent years have I understood that khaki can refer to both a military type green or sand like beige color.
"Oh, beige-green, sort of."
:-)
"ljus, gul-brun-grå färg som påminner om (väg)damm el. sand: kakifärgad HIST.: sedan 1904"