Unless you're referring to something else, the official [Alpine PostGIS docker image is 151MB](https://hub.docker.com/layers/postgis/postgis/9.5-2.5-alpine...), and you can find minimal images around 35MB.
These images contain geometry engine binaries like GEOS, which you will likely need if you want to perform operations other than `distance` at decent speeds.