I really like this idea. I think you could add in accelerometer support and make the phone function like an actual mouse, physically moving it around the desk like you would a physical mouse.
So while I'm sure you could make it work convincingly, it still wouldn't work as well as a proper rollerball or optical sensor.