Use 'mtr' to monitor packet loss on the network and see where it's actually originating.