Would like to understand too. On a new android 10 phone it was 1.7 seconds. Not that large, but in computer/processing time it is pretty large.
Your phone's settings should have a way to sync with the cellular network (for example, if you set a manual time and then choose set time automatically).
Cell towers (edit: in the USA) are usually within a second of time.gov, so your offset should hopefully be under a second after you sync with the cellular network.
It's somewhat common for CDMA cellular equipment to be used as a stratum-1 time source in lieu of GPS, since CDMA is easier to receive inside buildings. But GSM is unsuitable for this purpose, and since the long-term prognosis for CDMA seems perhaps less than optimistic, some operators may be forced to run a GPA antenna to the roof.