I think your memory is accurate. When I've had WiFi turned off in the past I'll sometimes get a pop-up message on my iPhone suggesting turning WiFi to improve location accuracy.