This only switches between windows of the same app. On Windows, with Alt+Tab you switch between all of the currently open windows of all applications.