I guess in some cases lowering altitude could result in flight into terrain or possibly entering airspace where collision with other aircraft would be more likely ?
The chances of colliding with anything else would be tiny. In case of other commercial jets zero, thanks to TCAS at the least.
TCAS = traffic alert and collision avoidance system