It is an immune system overreaction that usually kills you with this virus.
UPDATE: A better answer would be to worry to an extent proportional to the probability of other things that can kill you such as a car accident. So it's important to know the percentage of people in your neighborhood who are sick.