This doesn't happen in real time, but adjusts every 2016 blocks. So loss of hash rate will temporarily affect block generation time until the next adjustment.