Yes, and Windows will try to put an application window where it was if the program asks Windows to do that. If I am remembering correctly. (Big "if")

Why the onus is put on each application to turn this on is not clear to me.