It won’t be released immediately, that’s the point. It will be “released at some point in the future and definitely not during interpreter shutdown”.
A “with” statement ensures the release happens deterministically, which it turns out is a desirable trait to have.