hence it's important to have a good understanding of the chordal context when performing jazz. Outside notes that are too far away from the progression would likely be mistakes, but then there is this exception of atonal music. The more I studied harmony and theories, the more I'm overwhelmed by the possibilities when it comes to composition and improv.

Only if the "mistake" wasn't afterward incorporated into the improvisation does it become an actual mistake.