21 karma · joined January 5, 2018
At the end of the day, AI workloads in the cloud will always be a lot more compute effective however, meaning lowered combined footprint. However, in the server based model, there is more incentive to pre-compute (waste inference) things to make them appear snappy on device. Analogous would be all that energy spent doing video encoding for YouTube videos that never get watched. Although, it's "idle" resources for budgeting purposes.
I've been getting a lot of ads for a product with a similar premise ("AI-first Code Reviewer"): CodeRabbit.ai. Can you help me understand how this product compares?
How many tokens of training data have humans produced across the entire internet, all our written works, etc? Is there such a thing as a 216 trillion token set?
[0] https://arxiv.org/abs/2203.15556 [1] https://arxiv.org/abs/2204.02311
https://chrome.google.com/webstore/detail/dark-mode-theme-fo...