I'm on a 2009 MBP and have no such problems. Don't know where they could originate from, though.
You can improve performance slightly in the code editor by turning off the code folding and live issues (which I didn't really care for anyway), but the integrated interface builder is horribly slower than the one in Xcode 3.
Of course now I've upgraded to a 2011 Macbook Air and Xcode 4 performance is now...acceptable.
Running it as a 32-bit app seems to have helped a bit.