I've experimented with Chicago Boss a bit; it's an excellent framework, but I feel it still has a ways to go before it can compete with Rails.
Chicago Boss can't compete with all the users and plugins and everything that Rails has, head on, so it's probably best used where it has an advantage on Rails: stuff like websockets where holding a lot of them open is a piece of cake for Erlang, but more of a resource hog for Rails (at least it used to be that way, has 4 improved things?).