Asking that question just signals that you don't obey social cues.
Most hiring managers won't like this, as they don't want to be responsible for hiring someone volatile like this.
I think the only place you could get away with this is if you're interviewing with a C-Suite member who has nobody to answer to.