The Wikipedia article on Damore's memo lists a number of substantive criticisms[0]. For convenience, I'll list them here:
This Vox article[1] gives a brief background of Damore's argument from biological essentialism. It references the general consensus that the premise (that cultural and sociological gender roles result from innate and immutable differences in gender biology and neurology) has been discredited[2,3], as well as a Stanford research paper[4] which concludes “Through a rather constructivist approach most studies show that no scientific experiment has proved the existence of systematic and/or significant biological sex differences in most cognitive functions.”
This BBC article[5] mentions a criticism by a cognitive scientist, This Intelligencer article[6] lists numerous criticisms and rebuttals by scientists, referencing this Quora article by an evolutionary scientist[7], and another criticism from studies of gender and STEM[8].
Now, that's as many as I've been willing to list because I'm now thoroughly bored of hunting down sources, but there are many others I haven't listed if you want to do the research yourself. Now granted, wikipedia also lists a number of counter-criticisms, but that alone doesn't render the criticism invalid, it merely demonstrates the existence of a controversy.
I'm leaving this comment here for future reference, and referring to it every time I notice someone bringing up the myth that Damore's memo is based on rock-solid, unassailable science, or that no "substantive" criticisms have or can been made.
[0]https://en.wikipedia.org/wiki/Google%27s_Ideological_Echo_Ch...
[1]https://www.vox.com/identities/2017/8/8/16106728/google-fire...
[2]https://www.theguardian.com/science/brain-flapping/2016/may/...
[3]https://www.theguardian.com/commentisfree/2017/aug/07/silico...
[4]http://genderedinnovations.stanford.edu/images/TR3_Stereotyp...
[5]https://www.bbc.co.uk/news/world-40865261
[6]https://nymag.com/intelligencer/2017/08/some-scientific-argu...
[7]https://www.quora.com/What-do-scientists-think-about-the-bio...
[8]https://www.vox.com/2017/8/11/16127992/google-engineer-memo-...