Building a Concurrent Web Scraper In Python

Have a look at Python multiprocessing for true parallel threading: http://docs.python.org/2/library/multiprocessing.html