Currently I remap all backgrounds, text, and vector graphics, and I leave raster images alone. This works great for documents whose only raster images are photographs; some documents do have other raster images that might even have white backgrounds instead of transparent, so that's not ideal, but it seems to work decently well in practice.