OS-native dictation on iOS requires uploading your address book to Apple on every request, even if you don’t use iCloud. I unfortunately have to leave it disabled for this reason.
> Dictation sends information like your voice input, contacts, and location to Apple when necessary for processing your requests.