As a random data point: As I write this, irssi with perl and xmpp plugins consumes about 6M and never gets slow.