As a counterpoint, I know a couple who are both big-building architects for major firms who currently live worry-free in the Millennium Tower. I think the average person's perception isn't much use when evaluating things like this.
I wouldn't occupy anything in its shadow.
I also did briefly look to see if I could find any reference to a city engineer proposing dismantling the building, but couldn't find anything there.