I have observed this bot requesting URLs that haven’t been live for over a decade, and to which no reference can now be found in search engines. I imagine there must be a private trade in URL lists.
I would not be surprised if there are still some auto generated link directories left from the "golden ages" of blackhat.