There is no way or permission on (standard) Android to grant a trusted app access to your location, without granting it to Google first.
So, I have Mozilla location services running on my LineageOS phone instead of Google’s, but only because I'm that tiny minority of nerds who knows how to do all that. Ordinary people might prefer to simply install MicroG’s fork of LineageOS, which avoids Google outright and provides third-party location services.
I'd use GrapheneOS where possible. Consider making it possible where it's not.