The latency benefits of an extra caching layer are minimal, especially since HTTP pipelining and CDNs will continue to exist.