I have 4GB and yeah, my hdd is non-SSD. But it wasn't this bad back when I was working with snow leopard. Unfortunately Apple forces you to get their new OS to use the new Xcode and that has screwed my performance.
I've disabled a bunch of things, Spotlight indexing, dashboard, their notification stuff, etc and also moved swap to a new partition, its helped, but still not as snappy as when it was new.
At the moment, I'm weighing my choices .. do I upgrade RAM,SSD or do I get a new one - but then I have to buy apple's expensive ram and cant easily change the SSD in the future.