You've made a great point. Its very easy to get blinded by metrics that don't really matter. I am sure we have all been there.
"My app was downloaded over a gazillion times last month"
"So what, how many of those that downloaded it are engaged and actually using it?"