RL leading to weird and unexpected things isn't new or restricted to current AI systems.