The line between approximate and compute is a blurry one: some may say if the polynomial approximation depends on log of the error, meaning you can exponentially get better with each step, computation and approximation are the same.
Which leads into unknowingly building NNs that are actually building classification networks and not realizing approximations might not fit into your model.