A good number theory course (even just plowing through Crandall and Pomerance, or Apostol) will definitely help with understanding/analysing asymmetric encryption
I was hoping you would also recommend G.H Hardy's Theory of Numbers
I was hoping you would also recommend G.H Hardy's Theory of Numbers