I think the problem is that in a long list of edge cases, it's neither fake clever nor real clever but just "dumb". This is, of course, always an issue with computers, but what makes ML so vexing is that it's inscrutable.

For your fridge that's an annoyance, but when used for more serious applications the ramifications can be large. Example: https://www.technologyreview.com/2019/01/21/137783/algorithm... – there's much more where that came from.

ML works by taking a huge amount of data and finding patterns and is pretty much incapable of judging individual cases. We have ugly words for humans who judge people based on generalisations instead of judging the individual...

Computers and algorithms are devoid of empathy and humanity, I am extremely apprehensive in using them to make any sort of judgement call, especially if the calculation is inscrutable. Humans may not be perfect, but at least they're ... human.

ML is an interesting tool which can be used for many things, but right now it's also being misapplied for many things. I think a lot of opposition comes from that, rather than your fridge or whatnot.