I felt the same way using GPT-2 and AI Dungeon back in the day. The surrealism and incredibly short-term memory was a big part of the fun.