You need to start with the assumption that an infinite set exists (Axiom of Infinity) for uncomputable functions (and other weird mathematical things).

Such concepts cannot appear in a finite universe.