I'm using a PinePhone right now and I hope I won't need to switch back to Android. I grew used to this freedom.
However, I would recommend it only to the most determined people because many things don't work well.
Forget GPS navigation. GPS does not get the correct location most of the time, AGPS only works through a hacky bash / python script. There is no good gps app anyway.
The sms app on phosh is crashy and does not yet support MMS for which you have to use another hacky script (but I'm working on an alternative app).
The phone often needs to be rebooted due to the modem sometimes not waking up. Calls are not high quality. No built in way to have a reliable alarm if the phone is not plugged. Photos are bad. The phone is generally slow for many modern web apps targeting more powerful hardware.
The phone takes time to wake up for a call.
I would not want to experience an emergency requiring to call someone.
The phone is not waterproof so it will likely break if it takes a good rain.
The on-screen time is not great though you can buy spare batteries which can largely change the game. Remember to set the sleep timer to 30s, which you need to do using the command line if you use Phosh, it helps a lot.
A smoother transition could be to use a degoogled android phone, maybe with MicroG for cell/wifi based location and only using free software (from F-Droid). But you'll still rely on proprietary blob.
I only ever used open source apps on Android and always refused to use apps like WhatsApp & its friends, which helped the transition to the PinePhone.
On the flip side, the PinePhone is getting better every day and the ability to just buy a spare battery and a battery charger and swap them as needed without any tool is really nice.
I typed this message on the PinePhone by the way. It's far from horrible despite my comment.
edit: what I want to say is, wanting to migrate to free and privacy-friendly software is probably a good thing, but increase the chance it will work by not making it too hard. On the desktop, Linux distributions are delightful to use, free software phones are still pretty much work-in-progress unfortunately. The gap between a degoogled Android phone and a PinePhone is huge, probably way bigger than between an iPhone and a degoogled Android phone.