In my experience, I know within a fraction of a second whether I'm actually attracted to someone. I have never become attracted to someone later if I wasn't attracted in the first place.
But there's no way I could tell you what the criteria are for being attracted to someone. There are beautiful women I'm not attracted to and there are less photogenic women I'm very attracted to. There are so many factors at play: the way they carry themselves, their voice, their smell, that je ne sais quoi...
Swiping makes you think you are doing efficient filtration except it's showing you only an approximation of someone through a keyhole. I've met up with matches and found they don't look the same in 3D, we don't vibe and sometimes they just don't smell right (smell is an extremely important sense for attraction).
After wasting time with definite negatives that you thought were positives you wonder how many positives you rejected just because they didn't meet some criterion that barely matters.
All the real negatives swiping works for (like obesity, tattoos, peircings etc for me) would be easily filtered out in real life without even thinking about it.