You could just use ffhq/faces, it's fine. You'd think it gets stuck in a local minima but it really doesn't. Transfer learning from any 'finished' checkpoint is much much much faster than doing it from scratch.

Mapillary had object verification tasks for benches in the past, but I'm not sure they're part of their public dataset.