I think any simulation of a reasonably complex environment is an opportunity for AI research, but I am hoping that TrueCraft (https://github.com/SirCmpwn/TrueCraft) will do well so that researchers do not depend on proprietary Minecraft.
(it was frickin sweeeeeeeeeeeeeet)
Next project is to set up some arkham style gliding challenges, although in this case missing the target by even a small amount is like to result in death...
Pilot wings in Minecraft?
Sounds awesome. I enjoyed some of the dropper maps, and that game where you jump off a high point into a pool and place a block each time, making the target smaller and smaller each time.
Also, some of the major redstone additions from the later versions, which are the ones I'd miss most.