I hope somebody told the poster about putting a proxy server (squid, apache, nginx, varnish, etc.) between the application server and the client.
Proxy deals with slow client delays. App server serves app requests at speed. Tune number of proxy connections to keep app servers reasonably busy. Scale each layer individually.
IMO Whether the proxy is async or not is a matter of taste.