This is not a take your hat off indoors kind of thing which would be a societal custom. This is a do I know if we are communicating and do I have your focus thing.
You seemed to have missed out on the part of showing the same level of attention that they would expect if they initiated the conversation. That's a big miss on your part because there the core issue of the over developed sense of entitlement. Because no one says, oh yeah it's fine if I have no idea if you're listening to me or not. No we all get irritated. So just do what you'd expect if the situation was reversed. That's not cultural custom specific thing. That's a society thing.