I suppose there's a distinction to be made between quantity and quality of changes, too. Certainly regular sex mixes things up a lot every time, but only within the bounds of the established gene pool (roughly).
Compare this to, say, the famous example of adding firefly genes to tobacco plants, to make them bioluminescent. That's a small change in terms of number of genes, but very "sudden" in terms of how far it is away from the norm — it would have taken a very long time for that to have happened as a result of natural (or even breeding-style) permutations of existing genes. So it's a "big" change in that sense, even if "small" in the other.
As far as citations go, I think the Wikipedia page on GMO foods is decent? [1]
For instance, the "Gene flow" section describes the risk of various unexpected consequences of GMO crops affecting their surroundings: "There are concerns that the spread of genes from modified organisms to unmodified relatives could produce species of weeds resistant to herbicides[303] that could contaminate nearby non-genetically modified crops, or could disrupt the ecosystem,[304][305] "
Of course in general, GMO crops are seen as safe (with lots of of "more long term research is needed" caveats), but the page has various links to concerns and ongoing research along the lines we're been discussing.
[1] https://en.wikipedia.org/wiki/Genetically_modified_food_cont...