Is the H5 file type that much different than whatever the Pytorch versions are using?
The model is loaded from Huggingface during the instantiation of the stable diffusion class. It is loaded as an H5 file which I believe is unique to Keras[0]. I don't have any experience with Keras so I can't say if that is good or bad. I wanted to see where they were getting the weights as the blog post didn't demonstrate an explicit loading function/call like Pytorch.
Gonna run it and see... although I have like 40GB of stable diffusion weights on my computer now.
[0] https://github.com/keras-team/keras-cv/blob/master/keras_cv/...