Don't you have to scale your api too ?
I would much rather scale out my REST/Graph/RPC API instead of having to scale out a WS API.
And no, same hassle, same money spent. Thought about from the start server-side rendered pages are almost as cacheable as API responses will be. If you can't cache you're in for a world of expense at scale whichever way you go.