I interned on the API team this summer and it was as close to a startup as you'll find inside a company the size of Microsoft.
OneNote itself was launched over ten years ago as part of the Office suite, while the OneNote service is just launching and has been developed completely internally.