ISO defines usability as "the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use.

So your right with the number of clicks, but you also have to make sure that the user can complete the task (effectiveness), and that they are happy (satisfaction). From our own research the three; effectiveness, efficiency and satisfaction are very highly correlated together.