Conversely, you are losing the distributed computing gained by rendering on the client, and therefore need a bigger server to scale when needed. And HTTP caching can and should be used for API responses as well.
Sure, most clients may already be adequately provisioned, but only because so many websites with bloated Javascript have forced their hand...