Double plot twist, I need to VPN into a remote network and now all the CI network activity goes through the VPN as well, and some of it gets blocked (true story)
Your builds depend on the consistent behavior of remote servers? That sounds like a recipe for disaster.