No, this is a terrifying precedent to set.
You are completely inverting democracy.
If 98% of people vote that something isn't offensive, and 2% vote that it is, and your takeaway from this is "the thing is offensive", then how can anything ever be determined to be not offensive?