Unlike a student loan, I could simply refuse to pay back the 3%. In the relatively unlikely case a court held the contract valid, I could shed it in bankruptcy.

The downside case is much better with the "3% equity in a person" investment than a student loan.