someone uploaded the list without duplicates here https://mega.nz/file/wNsRFIBC#jXOrEsIXUwespGbjKrh1fX4OIq436I...

Hopefully with a way to patch it from the last download so you don't have to download the whole thing over and over. I wouldn't mind paying $5 / month for a service like this - for helping me avoid the red tape.