Ask HN: How do you secure your distributed servers?

Let's say you have a couple of EC2, some Rackspace servers and some other physical machines rented somewhere.

How do you approach the secure communications among these nodes? I don't think OpenVPN is a good idea (everything pass through the Server which becomes a single point of failure), so are there any other solutions out there?