I disagree. I think having some clicks ignored would be pretty annoying. The solution is to design your UI so that what people want to click on isn't jumping around.