> Isn't every algorithm reversible if you save the inputs?

1. No, it might be probabilistic or non-deterministic.

2. Depends on your definition of reversibility. Maybe it's the ability to reverse a single, highly-localized, operation, such as an ALU operation; in which it doesn't help that you can repeat the computation all the way from the input to the previous state.