Yep, you need multiple IP addresses and other tricks to create over 64K connections to a single backend: http://www.metabrew.com/article/a-million-user-comet-applica...
One workaround that comes to mind is to have each backend listen on multiple ports.