502 - Bad Gateway
Another cool thing about Mistral 7b is it runs offline, and I don't need to download any massive URL list that may or may not be current.
It does the work of finding URLs at runtime, offline (until it verifies the URL exists).
Another cool thing about Mistral 7b is it runs offline, and I don't need to download any massive URL list that may or may not be current.
It does the work of finding URLs at runtime, offline (until it verifies the URL exists).
I am not pointing to a solution, but a pointer to the solution. Showing what is possible. The solution is pulling/parsing the CT logs yourself.
And you haven’t shown me that you can even get all those for free anyway
I guess it depends on what you are looking for?
It's far less brute force than trying to randomly generate hostnames and then do lookups, and your solution also misses everything that is just random alphanumeric combinations, of which there are tons.
> And you haven’t shown me that you can even get all those for free anyway
Free? Maybe.
One of the points of the experiment was to see how much of a shortcut using an LLM could give me, as the developer.
I've done other LLM search experiments where I basically just prompt to "predict 25 search results for this query" and it's surprisingly good. You can also run a check to verify the URLs to splice hallucinations out of the result, but yeah, LLM is already doing a lot of the work for search.