One way to run LLM on android phone is to run
ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!
Cool project! Where is the source code for this?
It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp