It really feels to me as if the distinctions between countable vs uncountable; rational vs irrational; discrete vs continuous; all represent the boundary between physics and mathematics – an idea I wish I could elaborate more precisely, but for me stands only on a shred of intuition.
I've been interested lately in Stephen Wolfram's and Scott Aaronson's writings on related ideas.
Aaronson on Gödel, Turing, and Friends: https://www.scottaaronson.com/democritus/lec3.html
Wolfram on computational irreducibility and equivalence: https://www.wolframscience.com/nks/chap-12--the-principle-of...