IIUC you refer to "flying debris" from outer space hitting the surface of the moon. But the local lunar dust itself is a big challenge to be addressed for future moon mission EVAs: https://www.youtube.com/watch?v=0k9wIsKKgqo

This dust would probably be a physical challenge to equipment used to build infra.