"Premature optimization" has become a mantra for not thinking about performance at all. If users notice it, it's not premature.