One might argue that your debt to society is ALL of the legal consequences of your crime including not just imprisonment time but also fees, fines, etc. In these discussions it often seems like people have the feeling that the prison time is the sole punishment for the crime when in fact that's not the case. Your debt to society is the entirety of the consequences.

That being said, I've read some of the details of the particular fees/fines/etc and they are often times a wholly unjust prison trap that is difficult to escape. Laws that allow that sort of thing should be changed to provide reasonable cost offsetting onto people who commit criminal acts without creating nightmarish situations that people can't rationally be expected to deal with.