Better put: you should test to acceptable limits.
A nuclear reactor or medical software should be tested with any and all possible and impossible scenarios in mind.
Some forum or chat software? Not so much.
And obviously there are 50 million shades in between :)