It does follow redirects but I think javascript redirects are causing a problem occasionally, still a couple of issues I need to work out. The occasional url does not get parsed properly for some reason which is probably causing this error.