LLM has no long term memory(limited by context size or you have to do fine tuning which isnt efficient) and can't interact with the outside world.
You can augment it with retrieval systems(vector store, graph db, sql db + lexical/semantic/graph search) and give it access to tools like api, search engine and code interpreter. Then it becomes an agent.