> I still don't have the slightest clue as to how you could build the actual physical substrate for performing those kinds of computations.
I suppose a useful starting point for quantum intuition would be the double-slit experiment[1]. There's a huge amount of material written about that, so there's more chance of gaining intuition there than by diving straight into quantum computation. Another fun experiment to try and understand is the quantum bomb-detector[2].
To gain intuition about classical computation and it's physical implementation, you could consider the billiard ball computer[3]. As well as being intuitive in terms of Newtonian physics, it's also reversible, which is an important principle in quantum computers.
Now, consider what would happen if we used 'quantum billiard balls' which, like the photons in the double slit and bomb detector experiments, can be in superpositions and interfere with themselves; yet can still bounce off each other to implement logic gates (photons don't bounce like that, since they're bosons, but you get the idea).
We can use the principles of the billiard ball computer to encode our computation as the paths taken by objects (the balls) through space (our circuit). We can use the principles of quantum mechanics to allow objects to 'take many paths at once', and hence perform many computations at once. That's why quantum computation seems appealing for combinatorial problems.
We can use the interference effects seen in the double slit experiment to combine the results of these computations, such that the results combine constructively for the correct answer and destructively for incorrect answers (ie. which wire/optical fibre coming out of the circuit should contain a '1' signal and which a '0' signal). By taking a measurement after this interference has taken place, we can make the probability of getting the correct answer very high.
[1] http://en.wikipedia.org/wiki/Double-slit_experiment
[2] http://en.wikipedia.org/wiki/Elitzur%E2%80%93Vaidman_bomb_te...
[3] http://en.wikipedia.org/wiki/Billiard-ball_computer