Well, before breaking out a higher order analysis, I'd like to at least see a real first order analysis. The argument from potential at infinity is dispositive, but let's do some practice anyway:
Let A be the area of the capacitor, and dr the distance between the plates. Let c be the appropriate electrostatic constant for the coulomb force between a proton and the charge density on the plate.
At a point a distance r from the capacitor, the field effect from the negative side is, ignoring curvature effects, about
cA/r^2
The repelling charge from the other plate will be about
cA/(r+dr)^2 = cA/(r^2 + 2rdr + dr^2) ~ cA(1/r)(1/(r+2dr))
So the difference between the coulomb forces, i.e. the net force, will be approximately
(cA/r)(1/r - 1/(r+2dr)) = (cA/r)((r+2dr - r)/(r^2 + 2rdr)) ~ cA(2dr/r^3)
So the net force drops off approximately as the third power of the distance, to a first order approximation. Integrating over the radius, we have that the potential goes as -1/r^2, with the approximation breaking down near r=0.
Actually inserting appropriate constants of integration would make this argument robust, but would also just reduce to the argument from potential at infinity. Either way it's clear that the effect can't just be ignored out of hand.