you might want to look at yacy for that.

https://yacy.net/en/index.html