ParentFull threadali_chherawalla·with the metal infra its actually quite good. Agreed you can't run really large models, but inference is very fast and TTFT is very low. It's a beautiful experienceView on HN