That used to be true, but since KDE4 hit the scene, KDE is typically just as snappy. That's probably not true for low low memory situations, but in general that's been my experience.
And my primary desktop is i3, if that tells you anything. OTOH, even when running KDE I tend to use small tools such as leafpad, konsole, vim, etc.