Or to properly modularize your application with something like OSGi [1]. No more flat classpath and name collisions will be apparent very early on.

[1] http://www.osgi.org/Technology/WhatIsOSGi