Your analogy is off. With number theory, even if no one had an external use for it, progress was (is) made, new theorems were proved, so time was not wasted in that regard. The problem with the Collatz conjecture is whether the effort spent on it is actually generating any insights into the problem.