It's an idiomatic term. It means to use the thing you produce yourself. So when, in the case of Gmail, it is slow and painful to use for yourself, you will fix it.
I think the question wasn't "what is dogfooding" but rather "why do you say dogfooding doesn't work at large cos?"