Why is it worrying? If you have good password habits now, nobody will be able to get into your current sites using the old password, and you presumably don't care about the old sites any more.