Even if the election were delayed or cancelled, he was still elected to a 4 year term. The term doesn't extend indefinitely just because there wasn't an election. Directly from the Constitution, "The terms of the President and Vice President shall end at noon on the 20th day of January". It's actually very specific about when the term ends.