Strange, on my machine this file only contains the URL from when I installed Firefox and a bunch of URLs for Adium updates. Not any of the many other things I've downloaded...
Is it only listing things downloaded through Safari?
Is it only listing things downloaded through Safari?
Maybe Firefox downloads aren't included? Maybe it's watching the ~/Downloads folder? Can you confirm either?