Give it a chance and try spacemacs (and then after using it for sometime maybe start building something from scratch if you think its too big). The eVil (vim) mode works out of the box and mnemonic bindings are easy to memorize.