Could the model or algorithm be changed to make it deterministic somehow? It could help a lot if there were reproduceable outputs from deterministic baked-in silicon.
This will generally make them suck, though, a little bit of randomness is necessary for proper function.