There is a karma threshold for downvoting comments. It's not clear to me why you should ever have been able to ... perhaps your memory is at fault in this regard.