If you're okay compiling your own kernel I'd wager you could get by on around 30 odd megabytes using the Alpine base image (5MB userland and the rest kernel), though it would not be sufficient to do any compilation on its own.