I built an open-source project to recommend the best computing resource configuration for ai application, but no reply or feedback at all. So I wonder if AI application developers care about their GPU utilization now? Or I target the wrong audience?
I built an open-source project to recommend the best computing resource configuration for ai application, but no reply or feedback at all. So I wonder if AI application developers care about their GPU utilization now? Or did I target the wrong audience?
Valid point. Scaling up seems to be the default approach for many AI companies to enhance performance, albeit with potential environmental concerns. While transitioning to more specialized chip architectures might mitigate power usage to some extent, the overarching trend seems to be towards increased power consumption in pursuit of larger scale. It's a trajectory worth monitoring closely.
sounds terrific. we can see the model companies are seeking ways to improve the model performance as the priority currently. More computing power is needed now. I do agree with your two ideas, but I am concerning a lot about whether the current GPUs are fully utilized or if they truly need more GPUs to improve the performance...