One additional thing I've found that I needed (in Windows) is
(setq omnisharp-server-executable-path "C:\\path\\to\\OmniSharp.exe")
So it can actually start the OmniSharp server (EDIT: Possibly because I haven't installed OmniSharp so much as just unzip it)