If you start with the same weights, then the neurons with similar connections will learn the same things. Random initialization is what gets them started in different directions.