That does sound clever but I don't understand your example; in this case, would moving the mouse either way go the intended direction?
In other genres / types of games, especially where you don't control exclusively one character / vehicle from a fixed first/third person viewpoint, it is drastically less common.