Yes you will, but most criminals won't, that's my point. It's exactly like legalizing guns.
Encryption has a legitimate use in normal society, guns (apart from sport) are a tool applicable to a specific subset of society, easy to misuse or accidently use with extreme consequences.
I know (personally) of a number of cases where people have been killed accidently by guns, and more where anger/emotion has caused things to get out of control. This is not something that happens with encryption.
Simply said, they are not the same thing, stop trying to confound the issue.