Ubuntu is about optimizing the common case at the expense of the corner cases. If you want something that is actually stable, use Debian.
Debian unstable doesn't have releases, so packages that make major changes have to apply cleanly to a variety of configurations (not just whatever the previous version was). Since people are testing these packages daily, any problems are resolved way before anything is marked "stable". These changes are also incremental, so instead of a testing team having to work out 100s of major changes with a six-month deadline, they are made and tested as-needed.
The end result is a system that is very up-to-date but rarely breaks. (Debian stable probably "never" breaks, but it is not exactly up-to-date either.)