What do we think the author means when he uses the word "perfect"? He uses the words "in denial" and "deluded." He's implying that everyone's childhood contains some flaws that make later psychological introspection beneficial.
In that sense, he's obviously right. That's why "nobody's perfect" is such a bland truism, just as "no one's childhood was perfect."
So the real problem comes down to equivocation. The author means one thing when he says "perfect" and the reader understands it as another: "I had a lovely childhood, and it was filled with memories that I cherish, and it lacked any of those traumatic things you see on TV." Neither meaning refers to "perfect" in the sense that someone can get a 1600 on their SAT test.