If your body is not damaged enough. It would mean a lot of people would become really risk averse. If generalized it would fossilize a society really fast.
It's also worth noting that there are no hieroglyphs inside the Great Pyramids (which are supposedly said to be tombs), when the Valley of the Kings (an actual tomb) was caked in them.
Also, the only written text depicting the construction of the Great Pyramids, that I could find, is (again, supposedly) the Famine Stele. I find it highly questionable that there is only one text that tells us of the most notable construction of ancient Egypt's entire existence, and one of the most notable buildings to date. And not a single hieroglyph amongst the Pyramids' vicinity says anything about it either.
It's not very surprising that we don't have a lot of texts about the construction of buildings that are 4,500 years old. The pyramids are incredibly ancient, and were ancient when later pharaohs tried to understand who built them.
For comparison, the Notre Dame of Paris is closer to our time than the Pyramids were to the pharaohs who built their tombs in the Valley of the Kings.
Many have also been demolished in ancient times so the stones could be reused. For example the pyramid of Djedefre, son of Khufu who built the famous Great Pyramid. Instead of competing on size, the son made a smaller pyramid of more beautiful stone, but unfortunately the stone was too valuable to let stand and was repurposed over millennia:
"Queen of the Ptolemaic Kingdom of Egypt from 51 to 30 BC, and its last active ruler. A member of the Ptolemaic dynasty, she was a descendant of its founder Ptolemy I Soter, a Macedonian Greek general and companion of Alexander the Great."
So, inasmuch as she thought about the pyramids, it was as a colonizer.