I had a friend who lived in New Jersey in a water front property - he used to ride a jetski over to New York to stop for a drink at a bar in a marina. The issue was you had to pay marina fees to be allowed to dock there, so while it was fun it was actually a pretty pricey way to get to NY (and you'd be wearing damp clothes) - but he still thought it was a lot of fun.
He was OK but apparently the was a lot of boat theft in that area too.