Splitting hairs, but from the gemfile it looks more like bits of rails are dependencies.

That's not rails, that's a few of rails' core components.