What about security? Constantly pulling unreviewed code just because it passes unit or e2e tests does not sound like the ideal choice to me.
But yeah, I don't think they were releasing based on unreleased Rails master. Just running CI, and keeping it passing.