Yup. If I have about 40 tabs open in Chrome, especially with some Flash videos or JS-heavy sites, Chrome can easily chew up a a gig and a half of memory and slow everything to a crawl. There is no magic bullet.
Bumping my memory up to 8GB ($130 from crucial) helped a lot though. No more paging issues for now even when running photoshop, firefox, safari, chrome, zend studio/rubymine/eclipse (yes, I use vim too, but it uses practically no memory)