That in itself isn't. But we do jail folks for years over drug charges, don't we? And let that follow them around for the rest of their lives? It can disqualify you from a lot of stuff.
It doesn't matter what the crime is when folks are wondering why we let folks out of jail at all. It isn't so much the crime that was committed at that point.