Actual numbers, with the test harness that was used to generate them: https://github.com/gvnn3/netperf/tree/master/Documentation

If speed would be main deciding factor, I'd go with FreeBSD/Linux. OpenBSD network stack is still pretty much under big kernel lock so multiple cores won't help as much. Though in the 5.8 and -current branch they've made lot of progress in making the network stack MP-safe. See undeadly.org hackathon reports for details.

mozumder -- um... what?

But, here is an answer - 10,000 requests per second is 100 microseconds per request. At 100Mbps network speed, this gives (roughly) 10 characters per microsecond or a budget of 1,000 characters combined per request. We will take 100 characters for the request, and 900 characters for the reply. Of course, you could go with 1Gps network service, and multiply this by 10. But, you will need at least 20kpps "per core".

However, you also have to contend with disk i/o and/or the database layer.

Which OS? I think you are probably a long way from being able to answer that question. Note that OpenBSD will not be as "multicore performant" but that may not matter in your application.

At that rate, you are limited by context changes from userland to the OS. So you must use an event driven approach like nginx or node.js. In contrast to the Apache way of opening a thread per connection.

Also, make use of netmap: http://info.iet.unipi.it/~luigi/netmap/ That is available for FreeBSD and Linux.

10k messages per sec is doable. But probably not off the shelf.