The easiest conceptual handle is geometric: volume expansion, but seeing how this is related to the combinatorial sum over all permutations, or how those two point of views are related to the algebraic one (that a set of equations having a solution or not), is not easy to see even in the 2D case.
I won't be surprised if math professors don't have this issue like you said (especially if someone is comfortable with wedge products), but the vast majority of newcomers who are interested in understanding why something works rather than just how to use it struggle all the time with determinants.
Agreed that it should help if you got to learn wedge products first (I didn't).
But I don't know, it's been a very long time for me. It's good to have a variety of approaches to the subject.
I think this is what led me to feel unhappy about determinants when I was a first-year university student. You need to actually prove that the determinant is the volume of the N-dimensional parallelepiped, and the axiomatic proof doesn't do that.
So you need basically two extra lines after proving those things so that people can say "okay, the determinant eats ignores all input vector non-orthogonality so that it gives volume".
1. Excellent exercises. Challenging. Really make you put the concepts together.
2. Good, opinionated pedagogy. If you agree with the philosophy (among other things, determinants are not a beginner tool), the explanations are good.
LADR is hardly the only book to eschew determinants for a long time. IIRC Lang takes a similar approach, but is not as digestible.