Technorati was one of the inspirations here so that's great to hear.
> Would love to hear details about how you created the database, the infrastructure, etc if it's not a trade secret. Kudos on the launch!
Sure, it's actually fairly simple! The search backend itself is running on Typesense [0], which was very quick and easy to setup.
Due to the way ranking is calculated, I can actually avoid doing any real web crawling (though, I may add that in soon to help increase the index size). Ranking is based on submission to online communities, so all I really need is those submissions.
Using the Reddit, HN and Twitter APIs, I search for any submissions related to any blogs in the database, then those submissions give me the post URLs.
Once I have the post URLs, I just need to request those specific URLs to get the post data.
Then there's scripts for things like content extraction, inflation calculation, currency conversion etc.
All of those scripts are in python.
The frontend is a simple React app built with Next. All pages are statically generated.
Let me know if there's any more questions!