> API Gateway has a hard limit of 500 WebSocket connections per second

That particular limit is new connections per second, not total connections per second. Starting from zero, you could have 1.8M connections after an hour (per account, per region).