Another issue is that often GMO correlates with patentry, terminator seeds, IP lawsuits, and so on. But that's also a tangential issue.
The main issue is that, just like anything new, it puts us in the "beta testing in production" area, where the product being tested is "things which none of our ancestors have ever encountered, evolutionarily" and production environment is "our bodies".