LLMs and AlphaGo don't work at all similarly, since LLMs don't use search.

I think everyone expected AlphaGo to be the research direction to pursue, which is why it was so surprising that LLMs turned out to work.