Office environment is key to what you say. That is why you would be considered white collar. The literal white collars may be gone, but what you call "dressing like slobs" is just a modern adaptation of the same white collar idea.
Now, as it pertains to tellers, banks are typically considered to be an office environment, thus why most consider them to be white collar.