Nvidia RTX 4090 ML-AI and Scientific Computing Performance

tldr 4090 can do ~40% more images/sec than 3090 on resnet50.

if these preliminary results hold, i’m happy with my recent decision to buy two 3090s instead of one 4090 for the same price. still hoping a 48GB model is released soon, though the ridiculously large size and power consumption negates much of the appeal. relatedly, i’m power limiting the 3090s to 250w each and still get ~90% performance on stable diffusion inference.