Honest question: does the Austrian in your example not understand the deadpan/sarcasm or is he/she merely annoyed by it? Sometime it may not be a question of understanding but just of preferred communication patterns.
But yeah, there's definitely a lot of culture and context involved.