Wow, thanks! I knew about

  ## arrow up
  "\e[A":history-search-backward
  ## arrow down
  "\e[B":history-search-forward

but it works only for beginning of the line. CTRL + R shows results with keyword anywhere within the line and pressing it again shows next result. CTRL + Shift + R goes back one result.