As I remember it e^x is the only function which is its own derivative, which I guess makes e “natural” in some sense.