He was inspired by Iram of the Pillars, which is mentioned in the Quran (https://en.wikipedia.org/wiki/Iram_of_the_Pillars). There's an interesting overview of its role in his work here: https://lovecraft.fandom.com/wiki/Irem.