No, I heard this is a common misunderstanding. You can bounce light off particles going through ONE SLIT and still destroy the interference patten. Partivles going through the other slit shouldn't have been deflected - yet the interference pattern is totally broken!
What you are suggesting is there is a hidden variable theory.