As always, depends what you're doing, but this is not a crazy statement.

There are certainly fewer bombshells in iOS6 than iOS 5, but it's no stretch to say that adopting iOS 5 early on was worth 100s of hours -- it had huge improvements for dev.

Also keep in mind that the fewer OS versions you target the less testing you have to do.