I basically do the same with my beard within the chin… I usually pick those "not perfect" and also those who are grown slightly longer than their neighbors…
I forced my self to stop several times for a few months, but in times when I am stressed or less mindful I do it again -_-