You could state (2) as a contrapositive where your re-phrasing of (2) is:
If A is the set of all primes, then A is an infinite set.
Contrapositive proof: Suppose A is a finite set containing only primes. By (1) we know there exists some p not in A and therefore A is not the set of all primes.
I don't believe contrapositive needs law of excluded middle but I'm honestly not sure. Logic is not my area