I have friends who "got married" in a legally unsanctioned way. No tax penalty, but they still feel like they expressed their commitment to one another.

And yes, obviously there are massive downsides to this approach.