I have tried exercise ball and still own one. The only problem is that it does not work with high table. I'd love to switch to the exercise ball when I have to sit.
I also like the Kneeling chair[1] which is a similar solution although works mostly on keeping your back straight where as, exercise ball helps your core as well.