Yup, JVM takes up huge resources. But, when you put the app in production, you can be rest assured it will perform. JVM gives you piece of mind.
Do some testing to see how much memory you have allocated to the JVM - how much resources each of your rails apps are consuming.. Use a Heap Analyser (or similar) - it could give you good insights into what is hogging up the resources.