What limitations of math exactly? What you're talking about is not related to efficiency of solving the Halting problem on a machine with a finite number of states.
> Attempting to overflow it is impractical using cpu cache memory sizes, no hard drive needed. No matter how fast you go through states, there are too many possible states in the cpu, and too many states even a small program can iterate through while still eventually terminating.
You are assuming that you have to simulate going through all the running states of a program to determine whether it halts or not.
Why do you assume that you have to run a complete simulation of the program to analyze it?