His view is that they are presented as an arbitrary piece of magic that people really don't understand. And, exactly because they don't really understand the determinant, they wind up not properly understanding fundamental concepts in linear algebra. Such as Jordan normal form.
If your goal is actually to properly understand linear algebra, he's absolutely right. If your goal is to use linear algebra for a wide variety of practical purposes, though, determinants are often essential.