I think the 'depending on the resolution' is key. Its not really a matter of software to me, its whether or not the hardware can deliver the necessary resolution to replace a monitor that's typically 1.5ft from your face. If you can break the dam by executing on the hardware the software will flow. (I wonder how Hololens compares to Magic Leap's technology.)

I think it would be very cool to just have 3 tripods on your desk (a ball on a stick) that represent 3 screen spaces. You could reach out and move them around, telescope them up and down in the physical world and the headset could use them for triangulation to render an accurate monitor on each. You'd still have a keyboard and mouse in the first iteration and then slowly overtime give way to other forms of input.