Yep - you sure can. I haven't released it to PyPi yet, but it's committed to master and tested. You just have to override this setting:

    EXPLORER_CONNECTION_NAME

And give it the name of the django connection you want to use. We are in the process of moving from Heroku Postgresql (which only supports a single DB user) to Amazon RDS Postgres specifically for this capability. It will ensure that users of SQL Explorer have read-only access (something that is currently enforced by a SQL blacklist - a risky approach)