Love your analogy.
Cars performance is hugely dependent on use case and overall setup (suspension, engine (NA, turbo, supercharger, etc), coef of drag, etc).
Maps well onto the LLM surface.
Cars performance is hugely dependent on use case and overall setup (suspension, engine (NA, turbo, supercharger, etc), coef of drag, etc).
Maps well onto the LLM surface.
But if you just want to improve lap times it's way less of a priority than brakes, tires, suspension setup, cooling to keep everything happy, etc.
Kind of like if your RAM has to constantly page, you would see much more improvement from upgrading your RAM than overclocking your CPU?