Thanks. Have estimated this as 3B tokens as a round number at 8:1, but if you have a firmer number I'd love to know it.
Added to the Models Table (a few 'small' and 'tiny' models there, too):
Added to the Models Table (a few 'small' and 'tiny' models there, too):
I'll do a write up one day but for anyone else interested I have uploaded some information here https://ftp.bytebreeze.dev/ftpuser/
I need to do a serious cleanup to the code and host it somewhere more stable but the raw version of what I have so far can be found there.
If anyone gets it running, keen to hear feedback!