Something similar has also happened to me. In my case, the symptom was that the TOTP 2FA to systems at work started to fail. It took me some time to find that the cause was an around 1 minute offset between my phone and the correct (NTP-synchronized) time as shown by my desktop. Setting the phone to not synchronize its date/time to the network (and correcting its time) fixed it, but it's annoying since without the network synchronization, the time slowly drifts. My theory is that there's one single tower that does not have its time correctly synchronized, and that annoyingly it's the "best" tower when I'm sitting at my desk.

Since then, I've not trusted that automatic network time adjustment, and I leave it disabled. Periodically, I check if it's drifted too much, and if it has, I quickly enable and then disable the network time adjustment (in a place far from the misconfigured tower).