We're doing something similar for school archive photos in our product. We use class photos to find student labels, then use that to cross reference other photos around the same time period.