Its a shame to think people seeing this as a "self promotion", when its not. What i am promoting is the data that this crawler obtained, and all the insights people can get for free, just by using it. As opposed to an API, that will limit either the access for the data or the way you can access it, acessing the raw data on a database directly has no limits.

Anyway, thanks for the reference, i will make sure to add it to the project's wiki as a related link.