one possible solution is the one Mozilla Bespin went with where there's a hovering translucent scroll bar which varies in opacity depending on whether you're hovered over it.
MADNESS!!!! A context sensitive UI element that only appears when you want it to and doesn't clutter up the visual space when you don't need it? INSANITY!!!