(1) Given a finite set of primes {p_1, ... p_n}, then there exists another prime not in that set.
However, turning that into the following statement does require proof by contradiction (or, equivalently, the law of the excluded middle):
(2) There are an infinite number of primes
Euclid himself made statement (1) and proved it without contradiction, so looking at the original source gives the impression that you don't need it. But (2) is so similar-looking that many people incorrectly make the deduction that it doesn't need proof by contradiction either.