OnLive has gotten pretty close with their gaming platform. They've shown demos of Autocad software and I believe Photoshop running with it.
But latency isn't such an issue for compiling etc. Someone was saying in the instant google thread that 250ms is imperceptible for search (and I've heard 200ms for the command line, from Rob Pike on Go). That's much lower hanging fruit than for gaming, where 250ms latency is far from instant but unplayable.
Yet, it works. Shockingly well. Better for FPS games than strategy games actually (you notice lag on a mouse cursor more than anywhere else).