I suppose the issue is a data problem, there being relatively little high quality data explaining how things should be solved in binary. As such making the learning mapping between prompt (english) and good solution (binary) difficult.
Besides, how do you even check the result now without running untrusted code? Every run of the model you need to reverse-engineer the binary?