But isn't that the way it's supposed to be?

I have always thought of reputation on SO as a measure of the total usefulness of your answers. When people find your reply useful, they upvote you. It's thus only natural that long-standing useful answers will keep gathering points, because people will continue to find those answers useful. When your answers are no longer useful (say due to technology change), your points too will stop growing.