Hold shift while dropping the file to enqueue it. At least on macOS that works.