I'm interested in AI though no expert, though would find it interesting to see an llm (until a "real" AI architecture can be created, ie that can learn on the fly and have more "real" intelligence) that:
Rather than being trained on billions on words, it instead has a grasp of logic, physics and spatial reasoning beyond any human, with little common knowledge, that could be fitted in a few billion parameters, that could then be run by a mobile phone.
Perhaps, for questions needing "knowledge" ie most of them, it would have well structured depots of knowledge it could quickly access to gain a quick understanding on a topic for a question (eg biology --> DNA structure for a highschool project), or C++ coding, then it can search the internet (with a list of "better" sources to try first).
SO, it would be like having an alien that has come to earth that is super intelligent, however know nothing/little of humans and the earth, and you ask it questions.
And it fits on your phone.
No idea if this would work.