Wittgenstein famously did not believe in Gödel's incompleteness theorem, as well as thinking Cantor's diagonalisation argument was bunk.
Wittgenstein emphasised on numerous occasions (for example directly at the beginning of his lectures on the foundations of mathematics in 1939) that his interest in these proofs was _philosophical_ and that he never intended to criticise any of them _on mathematical grounds_. He explicitly said that his aim was not to interfere with mathematicians, but to investigate the _philosophical conclusions_ drawn by these mathematicians from their proofs.
What exactly Wittgenstein found problematic is hard to describe in a short comment, because much of it depends on Wittgenstein's view of philosophy as a whole, but one example is the platonist bent of Gödel's theorem and his conviction that there are some mathematical "facts" that can never be discovered by mathematical reason. Wittgenstein wants to ask what it means to say that something is "intuitively true", but not provable in any consistent system, but he does not want to object to Gödel's results, merely its "standing".
In Cantor's case Wittgenstein is interested in the concept of the transfinite and of infinities "bigger" than other infinities. He does not object to Cantor's proof at all, but regards the philosophical conclusions drawn from it with suspicion.
(One good example of a philosophical abuse of Gödel's theorem is the argument that computers will never be able to think like humans, because Gödel's theorem demonstrates a limit to what any computer can do as a formal system, but we humans can nevertheless grasp the unprovable statements as intuitively true. This is basically the argument by J. R. Lucas. This is the kind of philosophical nonsense that Wittgenstein wanted to attack and his position on these matters is coincidentally quite similar to Turing's position, who was a student of Wittgenstein's lectures on the foundations of mathematics.)
It certainly did not help that the so-called Remarks on the Foundations of Mathematics are in some parts highly selective constructions by the editors of his posthumous writings.
tl;dr: it's complicated. Wittgenstein never objected to the mathematical results by Gödel and Cantor, but he thought that their results were often blown out of proportion by shoddy philosophical conclusions made on the basis of these perfectly fine mathematical arguments.
These are excerpts, some paragraphs are missing, but the gist is more or less there and you can find the full discussion in 'Remarks on the Foundations of Mathematics'.
The Part II of the Remarks on the Foundations of Mathematics, which is the part on Cantor, is especially questionable. It is compiled from two documents of Wittgenstein's Nachlass, Ms-117 and Ms-121, but only about a third of the remarks in Ms-121 were included in the published book. There are also other notebooks were Wittgenstein discussed Cantor (most notably Ms-162a and Ms-126b) and which were not published at all. The editors made the decision to exclude some of these remarks because Wittgenstein's notebooks often contain merely drafts of remarks that were never fully developed, so it would be wrong to say that the published book is a deliberate misrepresentation of Wittgenstein's thoughts, but the situation is definitely quite nuanced and complex.
I personally think that the Remarks on the Foundations of Mathematics are very interesting, but that it's a disservice to Wittgenstein and any reader of his works to read his remarks on the philosophy of mathematics as a disconnected collection of aphorisms. The context really matters and his more mathematical remarks only make sense against the backdrop of the Philosophical Investigations and perhaps even his later writings such as On Certainty.
I'm guessing constructivists have found better ways to approach infinity than Witty, without conceding that infinity is real.