My guess is that DHS denies entry to random people just to hit some internal quotas.
>I can't believe anyone on the US Visa offices actually doing their research on the person.
Suspect Palantir, or some other contractor having some shitty software to score applicants based on social media + web searches + magic sauce.