rbenv has good fish support out of the box if you're willing to switch from rvm:

https://github.com/sstephenson/rbenv