Exactly this is the problem. The physics and engineering are well understood, nuclear reactors can be built and operated reasonably safely, but that'll cost (particularly when considering malicious actors).
Well, then there is also the issue of long term storage of radioactive waste ...