Best practice still has to remain to turn off your phone, or at least put it in airplane mode, before you leave the house if you need more privacy.
Maybe if you take a photo of something recognisable they could log your location at that point if the photo is automatically tagged when you connect later. Though even if that is the case, I expect the OP wasn't taking pictures of any landmarks during a journey to/from the abortion clinic.
I assume my phone just logs the location based on time and then submits when airplane mode is off.
https://old.reddit.com/r/LineageOS/comments/gdu8l4/aeroplane...
I believe the premise is that airplane mode disconnects the OS from the modem, but it doesn't necessarily turn the modem itself off. It's still hitting cell towers and phoning back to Qualcomm. If Qualcomm has this information, three letter agencies have this information.
Best of all is, of course, leaving your phone at home. But that seems to be well beyond most people's abilities these days.