Dask is popular for this purpose. No memory compression, but supports disk spillage as well as distributed dataframes.