I also have worked for QL, and there are actually very few of the workers that live downtown. Most commute from the 'burbs. I considered it and did a lot of research and here were my thoughts:

-The income tax needs to go. 2.5% to live in a city with pretty bad crime and no amenities? No thanks.

-Car insurance is through the roof. If you park on the street it's assumed your car will get broken into occasionally.

-I don't feel entirely safe. If I were to walk home from a bar at 2:30am I would be concerned. 20 miles away in any direction and I wouldn't think twice about it (I'm a young guy and I will not drink and drive, so this is a legitimate issue)

-It's actually quite expensive considering the above. A "nice" apartment in a decent part of downtown will cost $1k+/mo. Go to Plymouth, Northville, Royal Oak (high demand, up-scale areas nearby), and you'll be able to get a reasonable apartment for this same price, sans all the above issues.

I really hope it turns around, but my realistic side is a little worried.