Which Ubuntu image are you using? The official Ubuntu 14.04 image has always been only 4 layers and is about 190MB total size.