Ah, alright. Well I a big challenge will be your interface since that's the primary change between desktop/mobile development. And most people seem to be innovating on that. I did see a few interesting demos that focused on new UI paradigms. LightTable was particularly interesting. Even though it was never demoed on a mobile device, I don't think it's hard to imagine how LightTable might work on an iPad.
The hardest problem, I think, is the environment. The UI stuff (like getting the same density of information around and under your hands while you're working on a piece of code) will get solved pretty easily. I'm more concerned that closed systems (like Apple's) will be threatening to any type of local development environment. Even basic web development, I'd expect to get full access to the developer tools within mobile Safari if I wanted.
Remote development (via ssh, perhaps) is a compromising solution here, but I'd really like to do my development offline if I need to. Being tether to an internet connection can be distracting and something you want the option of especially if you're mobile.
I have seen some interesting attempts to create an all-in-one solution within Android (and can't find the project right now) that has shell access with vi and ruby/python/scala interpreters/compilers built in.
I think progress in this area is happening much quicker than you think.