You might have some sort of dangling config issue somewhere? I use the emacs keybindings in the Julia REPL all the time. They work fine out of the box (at least here).
The good news I guess is that having a clumsy REPL has really gotten me into vim-slime.