Hacker News Reader

How many users can you serve with that?

For the H200, between 150-700. The GB200 gets you something like 2-10k users.

Whoa. How on earth can one system serve 2000 potentially concurrent users?