Thankfully you can turn off voice control in iOS 10. Settings -> General -> Accessibility -> Home Button.