Yeah, thinking of the exp() part as a spirals in three dimensional space (the imaginary plane + the time/space line) finally helped me to understand what's really going on with the Fourier transform.