Deer are pretty smart like that. Where I live there are deer all over about 2 weeks before hunting season. Then they dissapear into the hills. They just started coming back now that the hunt is over.
Humans are kind of stinky so I'm sure they just need to be upwind from them to realize "oh lord the humans are back again, time to head deeper into the woods for a while"