My understanding is that the engineering for this can be done by someone who has studied the stuff, and uses publicly available materials. He or she does need to be competent but does not need to be Einstein. See John Aristotle Phillips. [0]
The main challenge is simply the industrial process required to collect the fissionable material. That is why Iranians have centrifuges and why Stuxnet attacked those centrifuges. [1]