That's not really the issue. The three body problem does have an analytical solution in the form of a power series, but the problem is that it converges so slowly to be of any practical use.
Thanks for mentioning the existence of an analytical solution at all though, I wasn't aware of that.
This is not universally true. Error behavior is a function of the particular problem, the algorithm used to approximate its solution, and the properties of input data. A large subtopic of numerical analysis is concerned with this kind of stuff. See [1] or [2] to get a flavor.