I've always been a fan of paying off the primary residence just for peace of mind. Can get a better ROI but if you're home is secure, everything else kind of just feels easier.
At the moment, you could do extremely low-risk things like buy US treasury bonds and come out well in front of where you would be by paying off a home loan early.
Almost destroyed me credit paying off a house when it was the only credit line I had at the time.
Versus money in the bank is money in the bank.
PS: For god's sake don't pay off your primary mortgage if you have a low rate fixed loan.