I remain pretty leery of raster in the database, for the reasons you list, but the power of GDAL to reach out over networks for raster access makes me a little more excited about some raster/vector use cases. It's not a panacea, but it's something.
https://blog.crunchydata.com/postgis-raster-and-crunchy-brid...