Not related, but this is traffic micro simulation Reinforcement learning framwork that my previous research group started: https://m.youtube.com/watch?v=P7xx9uH2i7w