I think it's possible to do that, though that wouldn't really be Bitcoin anymore. If the difficulty were fluctuating with the same amount of computing power out there, the block time would be changing a lot.

This would make for different amounts of bitcoins being released rather than the (fairly) predictable current schedule.