On Linux you can use the evim command to start up in insert mode, or to stay in insert mode in gvim, :set im