I've had it happen to me twice in the last year. One wasn't even a refusal, instead a simple dismissive hand waving gesture. I didn't relent and eventually got my seat, but had to have flight attendants intervene.
It's kind of astonishing to experience, to be honest. To witness someone committing to a thought process that is completely unfathomable to you.