Finding the closed form of the integral of a closed form, yes then what you say is true (this is different from 'analytic' which in mathematics has a different meaning). Scope of the concept of even baby integration of a function is much much larger, and OP is talking about that.
Note the key word there is a function not a function with a closed form that's a tiny subset.