I'd look into jQuery 1.4 (currently in alpha), which is broken into modules so that you can use less of it. This isn't yet released, but it's possible to build and use it from the source tree. See the comments in build.xml for instructions on building a smaller jQuery.

There's also http://xuijs.com/ which is very minimal and targeted specifically at mobile browsers. It may not support older desktop browsers, though.