Yeah, must be possible. Not fast, but possible if you have enough ram. I think you can search online for projects, I think I saw something related

Gemma E2B QAT will run on a 4 gig RAM pi.