As an Agile coach, I agree to an extent. Metrics can be and are often times weaponized by management to exact control over a project.
I wish more organizations saw Agile metrics, or any metrics for that matter, as conversation starters for the team to discuss how things are going and how/when to adjust course. It's a challenge to change habits of making binary decisions based entirely on metrics.