I find it hilarious that “from scratch” now somehow means “in PyTorch”.
And there's been a recent surge in abstractions over pytorch, and even standalone packages for models that you are just expected to import and use as an API (which are very useful, don't get me wrong!). So it's nice to see an implementation that doesn't have 10 different dependencies that each abstract over something pytorch does.
Andrej Karpathy did exactly that, and I think it’s quite interesting.
> ...when the goal is to show a reimplantation of something as "higher" level as SD.
Implementing autograd is interesting, but it's not directly in service to our main subject (Stable Diffusion) and would be a major yak shave. Comparable in complexity to the original project.