You might be able to do this with independent component analysis (ICA). There is a block in sklearn, but you would have to write some Python.
Alternatively, you might look to see if the speakers are in separate channels (if recording is stereo). Then it would be really simple - just take one channel out and resave as mono!
If you have a sample I'd be curious to take a look - sounds like an interesting problem.