Kind of tried something similar in the game called Rust: https://youtu.be/j674nbG4_t8

This is a style transfer via SD, Controlnet and EbSynth.