While the caching would be more effective with one large centralized instance, I think the intended use case is to have one cache per server. So then it's not really extra infrastructure.
Regardless, it's just a caching layer, and requests are passed through to the API in that case.