It might test well in metrics, but this is the kind of thing that points out why purely data based decision making can be dangerous. A-B testing assumes users will all behave the same in the future as in the past. But people's future behavior is dependent on their present behavior and experiences.

With repeated exposure to URLs more people will learn how URLs work. Hiding URLs means that people will never be able to learn.