That will be the dominating term eventually. But the initial sharp temperature drop is mostly due to the coffee mug being at room temperature and having a ~significant mass.