Full threadsujayk_33·I worked on something similar but specifically for transformer architecture: https://transformer.sujayk.me/View on HN