When you say "The OS feature that polls for activity" do you mean epoll/kevent? Because otherwise (and even then I think) it isn't O(1).

http://www.kegel.com/c10k.html