Wouldn't that depend entirely if the law was only in criminal law? If so, decriminalize would remove all of the illegality?
You can "decriminalise" something either by eliminating the entire piece of legislation, or by amending it to remove the criminal act within it. In the case of the latter, that leaves open the option of replacing it with other words that might indicate civil penalties. If that happens, that is still decriminalisation, and would be distinct from legalisation.