Debian is more conservative with changes - if you want your systems to be rock-solid, go with Debian. The downside is that it's so stable that packages are usually outdated, but in many cases there are more recent backports which you can cherry-pick.

In my experience, Debian's security team responds to new CVEs faster than Ubuntu's, but this is purely subjective.