Java is a terrible language to teach early programming: the features chosen to get to OOP get in the way of understanding basic control. Perl is better. Python is miles better. A dialect of Python with more explicit blocking instead of whitespace sensitivity would be excellent.
--
As for constructing a toy system with the plan to throw it away after you've learned from it -- isn't that what an MVP is?