Fun and easy mnemonic:
Port = LEFT (4 letters in each word, same vowel/consonant placement)
Port = Red as in Port Wine
Therefore, navigation lights: Red = Port = Left
If you remember that, then starboard is just "not port"