smallest OS possible is no OS , second best which I use is tianon/true image from docker registry, 125 bytes, with my compiled golang app as binary image size under 5 mb, https://registry.hub.docker.com/u/tianon/true/
reference https://github.com/senthilnayagam/godockersample
edit: added a implementation link