Its a false duality. It assumes complexity is zero sum, either the user has it or the programmer has it. In my experience this is not true.
It's all subjective, and the design of the high level concepts (maybe mechanics?) influence the complexity at every level below it. The idea of a 'file' goes from the GUI down to the hard disc format.