Consider, for example, that a large portion of the labor on these projects must be conducted in large negative-pressure gloveboxes. Just the engineering to design these gloveboxes and systems for loading materials in and out of them, without releasing contaminated particulates, can be a significant expense. You then have to operate an extensive environmental monitoring program, health and safety precautions and services for workers, and at the end of this all in-out time takes long enough that workers aren't able to actually work for a good portion of their shift.
The safety concerns here are significant and complex. For example, remediation efforts in Los Alamos have struggled with a high rate of rotator cuff injuries among the workers due to the placement of pass-through locks in the gloveboxes. This has necessitated development of a new glove box design.
When working with dangerous materials, every individual step of the process becomes much more complex. You end up with more staff to perform safety and environmental monitoring than to actually do the work. Workers need more workers to help them don and doff protective equipment. It's a bit like working in space.