Does the government need a reason to revoke a persons visa? First amendment or not, that is the real question. If no reason is needed then whether the first amendment applies or not is moot.
There seems to be broad discretion that the government has in revoking visas.