Immigration rights are not tax breaks, and they are a hugely valuable benefit of marriage. Marriage gets you a green card within two years; attempting to do the same as, say, a 25 year old with a bachelor's degree could take upwards of 7 years. (Marriage is also much cheaper)
There's other rights, like hospital visitation, legal indemnification, etc. that also don't fall into that category.