It's a big jump from "this behavior annoys me" to "I hate a person".