There are a few different web frameworks (someone mentioned Phoenix for Elixir; Chicago Boss is Rails-like in Erlang) you could make use of.
Less of an ecosystem depends on what you're doing; if there's a real challenging component that a Ruby library makes easy, and no compelling Erlang/Elixir equivalent, yeah, that's a major consideration, but I suspect it happens less often than you think (I've never had a situation in Erlang/Elixir where I could reasonably expect a library and not found a decent, if not ideal, one).
The time to ramp up certainly would count as a downside, but I also find I work surprisingly fast in Erlang (not really used Elixir professionally), enough to where I find it more pleasurable, and easier to debug, than I did Ruby.
For specific use cases where you'd -really- benefit writing Erlang/Elixir; the Erlang language and VM was built to be fault-tolerant. All the design considerations were for that. Talk of scaling is possible because having a sane distribution and concurrency model fell naturally out of a need for fault tolerance, being able to isolate execution paths from each other and resume them individually, etc. Scaling is what makes it 'cool' right now, but it's not where the real benefit to a webapp writer is initially, fault tolerance and concurrency are. Each request can be handled concurrently, while being isolated from all the rest, and a failure in one will generally have no effect on any of the others. That is awesome.
So, what are your requirements? Is one of them "we need maximal uptime"? Erlang/Elixir becomes a contender then. And if there's ever an expectation of it needing to scale, it suddenly becomes a serious consideration. And if you want real time server pushes, Erlang/Elixir websocket support > Ruby's, as others have indicated. And if the library functionality you need is equally well supported in both languages (or an equitable tradeoff between a couple different ones), and you can justify the time it would take to learn the language, or have already put in the time to get comfortable with it...