Just by including jQuery in a project I was able to shave a total of 22kb off a range of files without much trouble. But the current release version, minified jQuery is about 23kb. It's a balancing act.
EDIT: Also, in the next version of jQuery, they plan to separate out the core code such that you can include only what you need, so that 23kb will drop to only what you need.