Only if the "mistake" wasn't afterward incorporated into the improvisation does it become an actual mistake.
There are also chord changes that are too complex for me to interpret in real time.
Adding to my woes, between any two wrong notes, there are infinitely many wrong notes on my instrument.