Wonderful project! The kind of filter you use is very smart. Thanks for sharing, Im definitely going to try and use it to find some good ideas.
Also, Im curious, are you scraping data from App Store, etc or are you retrieving it real time through their apis ?
sorry i missed you for 12 hours, i am scraping the data from all of the platforms. Will add some more later, now i am working on some functionality to add custom ideas/apps, so people can share their idea and maybe also find people to work with.
Is there a certain time interval at which you scrape for data?
for example - get data every x seconds.
What is the 'x' here?
The pause is 24 hours. Once running it wont stop till there are urls with some pattern to crawl, there is also a limit to stop when enough pages didnt have an app
That's neat. Great project
thx :)
but i guess its not high quality enough.
Looks great to me. Why do you think it is not of high quality?