That doesn't automatically follow.
First, it ignores crimes committed while in jail, which is totally a thing - but at least hopefully the impact of those on "innocents" is reduced.
Second, if punishment reduces honest opportunities and increases criminal opportunities (networking?), enough new criminal acts may follow to make up for the lost time.