A simple GUI would be great to let the user select high quality 3-4 matches (reference points) between the image pairs. Then the rest of the stitching pipeline could stay the same.
If your images are just a random bag of jpegs that came in from the cold, then it's harder for sure.