I think one of the points he is making is not that it's just dark orange, it's that we have a label for dark orange, but not a label for dark other colors on the same level of use as brown.
We call dark orange brown. Sure dark red could be called burgundy but it's not a word used as much as brown. So we use the word brown as much as the words 'dark red'.