I used to have this problem and I remember it being DNS related. It was a while ago and I don't quite remember what I did to resolve it, but it had something to do with disabling IPv6 dns resolution while not using IPv6 in about:config and possibly something else as well.