> b/c whatever special sauce is hidden in the black box can be inferred from its outward behavior.

This is not always true, for an extreme example see Indistinguishability obfuscation.