Do you have a good visual of what would be best here? I've been making sure my fan is as tightly sealed around the window as possible, but it'd be interesting to learn if there's a better solution.

Yes! This video covers window and fans in more detail : https://m.youtube.com/watch?v=1L2ef1CP-yw