For me, it was the argument passing syntax. I had to look up the magic sigil for doing hashref stuff every single time.

One day I tried Python, learned that everything is passed by object reference, and set Perl aside and never looked back. There was so much less mental overhead that Perl never lured me back.