And when you use it, they get to collect all of the data about your visitors.
Nothing about this API requires handing over more than the bare minimum of information (which domains you want logos for). How could they be expected to implement it without that information?
If you want to preserve user privacy, you should definitely proxy this API.