It would be helpful to see this graphed over time. Also, how do you rule out service quality problems at the server's end?
I currently don't account for that. I guess I could ping something always stable like 8.8.8.8 or something as a baseline to compare against.