I don't believe Ubuntu on Windows is fully there already, but I have not tried it out yet.
In addition to Bash I would like to have, for instance, a full fledged graphical Emacs, the Dolphin file browser and the Konsole terminal emulator. So a headless VM would not really be enough -- does Hyper-V work well with a graphical desktop?