If you use emacs, it has org-mode which is very capable. It'll handle task organization, prioritizing, time clock, scheduling, invoicing and more.
Look here at http://orgmode.org/ and http://doc.norang.ca/org-mode.html for brief and in-depth use information.
Good luck.