You're forgetting that those non-Qataris are almost all migrant workers, so the population is extremely skewed towards relatively healthy 20-50 year old men. Also, people aren't just worried about directly work related deaths, but about bad living conditions in general.