https://bbchallenge.org/story#what-is-known-about-bb
(People have proven in Gödel-style that eventually any given mathematical theory is not strong enough to confirm, by any method, that a specific high-enough BB value is correct.)
And it famously "grows faster than any computable function".
https://en.wikipedia.org/wiki/Busy_beaver#Maximum_shifts_fun...
The people running this challenge believe that confirming with certainty the very next value, BB(6), probably requires answering questions that are, or are equivalent to, mathematical conjectures that humanity will never resolve.
A closely related concept about quantifying the behavior of all Turing machines is Chaitin's omega
https://en.wikipedia.org/wiki/Chaitin%27s_constant
which has similarly bizarre properties about it being as hard as all of the rest of mathematics to calculate digits of this number.
More precisely, Chaitin's Omega quantifies the behaviour of all Lisp expressions, since he defined it not in terms of Turing machines, but in terms of a universal lisp interpreter. Not your standard lisp either, but a minimal version geared toward Algorithmic Information Theory [1].
[1] https://www.jucs.org/jucs_2_5/the_limits_of_mathematics/Chai...
https://bbchallenge.org/story#goal
Since nobody has found any busier 5-state beaver than that since 1990, Scott Aaronson conjectured that this might be the actual maximum for halting 5-state machines.
"This conjecture says that 47,176,870 is the maximum number of steps that a 5-state Turing machine can run before halting (starting from all-0 memory tape)."
So, we can run up to this number and either the machine will stop - and we'll go to the next one until exhaust the whole set - or the machine won't stop, and we'll refute the conjecture.
If you simulate a Turing machine up to that many steps, and find it hasn't halted yet, then the conjecture is refuted if you know the machine's execution will eventually terminate -- but famously, there's no algorithm that can reliably tell you whether or not a given TM halts.
If it was just about the maximum number of steps that could be executed by a 5-state Turing machine, it would be trivially false, because it's easy to construct a Turing machine that runs forever.
"This conjecture says that if a 5-state Turing machine runs for more than 47,176,870 steps without halting then it will never halt (starting from all-0 memory tape)."
No, you do not refute the conjecture if you run up to this number and a machine does not stop. Finding a machine that runs for more than 47,176,870 steps is easy - there are plenty of machines that run forever. The trick is that it needs to stop.