Chocolatey seems to implement a subset of the functions that apt-get is useful for.
On Windows if I want to look for system updates, I use Windows update. On Debian I use apt-get.
On Windows if I want a library to use on a project, I use NuGet. On Debian I use apt-get.
On Windows if I want to install a bunch of free applications, I probably will use ninite, but chocolaty looks like a nice replacement for this. On Debian I use apt-get.
That said chocolatey seems like a nice tool for windows.