No, it’s literally true. For different people in different contexts “you’re an idiot” can be both offensive and not. Even Intention to offend doesn’t matter in the slightest. For instance if I don’t care about somebody’s opinion, his statement that I’m an idiot is simply ignored.
Offense is taken, not given.