There is some research on layer duplication on existing pre-trained models. This paper also references layer skipping: https://aclanthology.org/2025.findings-emnlp.967.pdf
11 karma · joined October 11, 2024
Released only 10 months later, a tiny open-weights model outperforms what was once SOTA. Fable and 5.6 Sol will be outperformed by laptop-class models next year.
Cloudflare R2 object storage is S3-compatible, offers free egress, and does not share their CDN product's fair use policy against image-heavy use. Storage is 65% the per-GB cost of S3.