This feels like a solved problem entirely: Kagi. I don’t know their secret sauce but the results are very high quality.