Rio is not some city in the middle of nowhere from which no flights are coming in and out of, and now suddenly this massive international influx of visitors will come in -- it is a world-class city, a financial hub of the largest country in the continent.
If we take London 2012 as a benchmark, estimates there are that the olympics yielded a 13% increase in foreign visitors from the previous summer. And that is London, a place where access from other destinations is cheaper, the infrastructure better, and a lot more appealing to U.S. visitors (due to some of the things cited above). It is completely reasonable to expect that the delta in Rio should be roughly the same, if not smaller.
The fact is that the"impact" on travel due to the Olympics will be negligible in a city like Rio -- and the economic impact is CERTAINLY negative, unless you are drinking the Kool-Aid of organizers.
I'm fine with cancelling the games, but claiming that not doing so will lead to a much riskier global health situation than the one we are already living is hogwash.