There just isn't a place for them in my life.
There just isn't a place for them in my life.
Probably the single most impressive result I've had so far was with "What's that weird thing on the top of a P-38's engine nacelle that looks like a recessed sideways wheel?" Got it in one. I can't imagine getting anywhere with a conventional search engine there.
I definitely wouldn't rely on it for anything professional, though.
Additionally (more importantly), the most magical part is still the architecture: there seems to be no end to the expressivity of transformers as long as you can pour in more compute. This can be extremely powerful and lead to more generalizable reasoning given the right learning objective (e.g., pose tasks as an RL Markov Decision Processes where state=text, actions=tokens, rewards=performance of generated code/math/language).
Even if we want to call them sophisticated autocomplete, why would I ever switch back to a dumb autocomplete?
I haven't actually tried copilot so I can't comment directly on that, but I have found the general space of LLM's to be useful.
Things like "how to do this", "how does this work", questions about medicine, DIY, etc …
And contrary to the content farm internet, it allows you to have a real conversation to give you more précise information.
Is it 100% accurate ? I think not. But it’s trained on nearly all the books about all the topics so I put a lot more trust on this than on SEO optimized content farms.
The best way to chat with it is to think that you are talking to someone who have read and remembered everything with an endless knowledge of everything but who acts as an faillible human when you speak with it.
It may be a fancy Markov chain, but it seems to have understood the code it documented.