Its deeper than that. Calling the fused location api contacts google's servers with location data. It is the only API that's well supported and documented. Using GPS sensors directly uses tons of battery, takes minutes to get a fix on most phones, and doesn't have access to some of the google-provided features like geofencing and wakeups on events.
A "g-free" phone can get location, but it's purposely hampered.