In German would you say "I'm one four and 80" for 184cm? Cause that's confusing :)
But yes, that's exactly how you would say it in German. There might be some part of the brain reserved to parse that sentence as "I'm (one) (four and 80)" but this doesn't feel weird or confusing at all.
Telephone numbers on the other hand are more confusing. Luckily you don't need to say them out loud anymore these days.
And in fact so does English — it’s twenty-four but fif-teen (five ten, not ten five). In german we do that until 99 (nine and ninety).