I've ruled this out as a possibility. For instance here I was the 4th comment (there are now 16), I posted 28 minutes ago and I'm still at the top comment slot at only 1 point.
It must be more than just a function of time and score, otherwise any of the new 1-point comments would have superseded mine, but they didn't.