Yeah. If you smoke weed, you deserve what you get.
On the other hand, there are crimes where you should certainly be in prison. Hard to argue that a child molester or murderer should be living in great conditions off taxpayer dollars.
If you're talking about prison as in convicted and sentenced, I disagree. Prisons are overcrowded as it is. Minor/nonviolent criminals are not the ones serving time.
If you're talking about jail as in people who are charged and awaiting trial, yes you will find more nonviolent offenders there and they may not be able to afford bail so they are stuck there. Even then in most places space is limited and first-time offenders and those seen as low risk are not held.