Came here to mention unittest.subtest. It's for exactly this case.