"Pardon me" and "sorry" on the other hand are, in my experience, used politely.
"Pardon me" and "sorry" on the other hand are, in my experience, used politely.
Or something like that, anyhow. It's certainly possible to make it ambiguous, in which case it will simply be interpreted according to the mood of whoever hears it.
If it is meant rudely or not is entirely based on the person's mood who said it and the vast majority of the time, the reason it is said with contempt in their voice is because the other person is ignoring social norms and being rude themselves.
Your example of standing in a crowded shop is quite apt here. The socially acceptable thing to do when you notice someone who wants to get by is to move back slightly and try to let them through. When you just stand there blocking the path without even trying even in a crowded shop, you have broken social norms which annoys people.
It can also of course be also be used rudely when someone is in a rush and is frustrated that people aren't obeying social norms fast enough, but I find that to be far more rare.
"Please pardon me" is getting better, as is "I'm so sorry," etc.