Another down side is, you don't want to do this if you're in the swampy south. You'll bring in all the humidity and that will cause all sorts of problems. Also, you bring in any dust, pollen, etc that may be lingering.
Last time I noticed, nobody makes a window-sized AC-esque filter that works efficiently down to PM2.5 levels... and doing so would also eliminate said window being a window.