This is really cool!
One issue I noticed though is that if you use gestures to zoom on a touch pad, then you'll end up in the wrong spot.
For instance, I put my cursor on Sydney with a Lambert projection and pinch to zoom. As I pinch in, my cursor moves away from Sydney as the map rotates, so the centre of the map ends up at some other place.
Ideally, it should cache the geographic coordinates of the cursor at the start of the pinch gesture and zoom around that till it receives a non-pinch input.