The biggest pain point with Ruby these days is: there is almost no libraries for modern number-crunching techniques of any kind. Only python libraries come out of machine learning community / academia.
Can I invite you to browse the repositories here https://github.com/ankane?tab=repositories ?