I used a portable version of Word 2003 for many many years. It would run off an old 128MB flash drive.

The extra clicks every time you try to save anything in newer versions of Office before you can get to a file picker dialog is truly maddening.