Why not just make the link rel="nofollow" until it reaches a certain threshold of points and or comments?
My only hesitation is that someone might see it as a reason to create false accounts to game upvoting. Maybe a certain threshold of upvotes by users with high karma is what it takes to remove nofollow from an auto-link?