We didn't push it on children: that's an executive decision.
-- Nathaniel Borenstein
That is of course a far stretch, but I would argue that your argument is too. Non-complicit workers might have just lost their jobs and would have been replaced with complicit ones and the bomb would still be dropped.
For this to make sense I think it's important to look at the distribution of power really. Considering the power of the people who order the bombs and factory workers not really having a leaver I don't think their actions make a difference.