The iPhone is not logging your location. Rather, it’s maintaining a database of Wi-Fi hotspots and cell towers around your current location, some of which may be located more than one hundred miles away from your iPhone, to help your iPhone rapidly and accurately calculate its location when requested
This actually makes sense - looking at the logs on my iPhone and iPad, the locations where pretty far away from the places where I usually roam, and actually there was a very great deal of places where I've never been, not even close.