This seems optimistic. I did the math last week, and 0.2% of New York City had died either from the coronavirus, or from something that was probably the coronavirus. About 21% percent of New York City was testing positive for antibodies. (Both deaths and antibodies are lagging indicators of infection, although a noticeable fraction of the deaths lag by quite a bit.)
That would give us an IFR around 1%. If we needed to have two-thirds of Americans catch the virus to reach herd immunity, that would be about 2 million dead. With any luck, some people are already immune. And as you point out, variation in susceptibility may stop things earlier than that.
The are some nasty side-effects in some percentage of survivors: Impaired breathing and damage from blood clots seem to be two of the most frequently mentioned, and Wuhan is apparently seeing a spike in dialysis patients.
The CDC is predicting 3,000 deaths/day in the US by June 1st. This seems plausible: We'd only need a few other metro areas to have a NYC-style spike.
So far, several countries do seem to be able to control the virus. But at this point, I increasingly fear that the US will not be able to do the same. We don't seem to be able to ramp up testing, and we haven't gotten the infection rate down to the point where contact tracing would work. And significant portions of the US seem to be giving up on control and going for a herd immunity strategy.