I think that's a really important, fair point. Whatever this guy lied about with regard to his personal experiences in China, those things are minor compared to the truth of the situation. I really wish he hadn't done that. He didn't need to lie -- the story is so fundamentally awful that it stands without the minor things he fabricated. But now people are dismissing the whole message.
The dramatic indignation in the other comments in this thread is predictable, unenlightening, and unhelpful -- far more heat than light. The most dangerous thing about this controversy is that people will take knee-jerk reactions to Daisey as an indication that nothing is wrong with the world of electronics. And that's a tragedy, in the most traditional sense of the word.