isn't this called "transfer learning" and quite common in ML field now?
If you come at this from the engineering perspective your goal would be to write controllers using a NN substrate and then make then make them updateable through experience.
If you come at it from a pre-trained deep net perspective your goal is to find a smaller (probably shallower) network which captures low level motor patterns. You might do this by distilling a truncated larger net.
Either way you're looking for a separate component that can be plugged into a larger agent system.