You can, it just makes some of Rails' niceties unnecessary. Views and "Controllers" are handled up front by backbone. You just need routing and models from Rails.
backbone.js sends CRUD requests to rails app which are handled by the controller, and the main page is rails view.