I agree. That's why I'm not really thinking about the invoicing angle like some of the other tracking apps seem to do. Making accurate project estimates (and measuring current progress) is at least as important and relevant to a lot more people than just freelancers.
there are other reasons to track time, starting with legal proof that you worked on the project.