Use a model already trained on Wiki[edia using llamafile.
You can download llamafile and several models, put them on a USB drive or hard drive, them send the drive to him via DHL.
You can download llamafile and several models, put them on a USB drive or hard drive, them send the drive to him via DHL.
I think he wants to tinker, and learn more about how they work. What I neglected to mention is that he's already learned to program (developing Android apps, and he's also learned Python). He is a very bright and curious kid.
LLM training in simple, raw C/CUDA
----------------------------------
https://github.com/karpathy/llm.c
It is only 1,000 lines of easy to read C code. There is also Python reference code.
The project is an idea at the moment. My contact in Kenya has direct access to the Principals of the schools that our supported students attend.
My thought is that the teachers would not have to do much. Many of the students already know python and could do self-learning individually or in groups.
A flash drive with llamafile+models and documentation might be all that it would take to get them started - even offline.
Bonus: Using llamafile, the same binary distribution works on MacOS, Linux, and Windows.
I wasn't aware of Phi-3 - I will look into it.