I have a desktop with three monitors and a laptop with one, and I don't notice any difference in distractibility. It's a discipline problem, not a technical one, and so you should solve it on a personal level and not a technical one.
I mean, think about it. If you "unlock" the ability to use multiple monitors at once without getting distracted, "it's free real estate" - you have more space to work with, and there's empirical evidence to suggest that that results in increased productivity. Programming involves a lot of consulting documentation and using multiple tools at once - it's very amenable to multiple monitors (as opposed to, say, writing a novel).