Are there "recommended", pretrained image featurizers -- maybe intermediate layers from CNNs and all that?

I know easy-to-use object recognition models, but for general clustering, metric learning, etc. tasks it would be useful to have an abstract embedding.