I mostly agree with you, but referencing Michael Levin, I'll contend that even individual cells have quite some intelligence. Granted, different from ours, but really good at solving the kind of problems cells have to solve.
Do the cells "have" to do anything? Do we? Sure, they might die if they do the "wrong" thing, but 1. Who's to say the inert state of "dead" matter is any worse than the state of a living cell, and 2. Cells clearly aren't always optimizing for their own survival anyway