From the docs it looks like this feature only reverts the edit tool calls, and not e.g. bash commands that have been executed:
> Checkpoints apply to Claude’s edits and not user edits or bash commands, and we recommend using them in combination with version control