That's a good idea, but much harder to implement than it sounds. Being a small time drug dealer may be a victimless crime to many people, but it certainly isn't to parents who've had a teenager who's OD'd.
And then there are crimes like insurance fraud, that don't hurt any one individual, but do make the cost of living higher for everyone else who's premiums go up as a result.
TLDR; it's very hard to determine which crimes are and are not "victimless".