Lets continue your hyperbolic argument.

Should we give every individual easy access to ICMBs, Tanks and Nuclear Weapon ?

The difference is two fold.

1) Encryption is useful to society outside the need for killing people. That is why you really cannot compare encryption to guns.

2) Even When criminals do use encrpytion - its used to facilitate killing rather than a direct way to kill people.

Someone cannot just throw a bunch of random paper filled with numbers and I will fall dead. There is a long chain of events between transmission of secret information to people being killed. If you give the world's top two criminals access to encryption but lock them away in a plastic room - they cannot even theoretical hurt anyone.

TLDR : Guns are stupid and people who like guns are stupid