Don't you then have soap residue on your glasses, plates, and cutlery? I assume it's probably not a problem for your health to consume trace amounts like that, but I'd be surprised if it doesn't affect the taste of whatever you later eat using them.