You can disable the Find My network, which is a separate option/setting from Find My for your specific device(s).
It's found under your iCloud Settings > Find My
The only major caveat to disabling it on your devices is it removes the ability for those devices to be located when they're turned off.