I agree, college mathematics education is usually horrible, especially in the start. I remember back when I was attempting to read my calculus 1 textbook and not understanding the thing at all. I realized that about 3 or 4 classes later in discrete math the reason why is because it was using fairly foundational mathematical terms and concepts such as sets, proof by induction and so on that it was small wonder why my calculus textbook was incomprehensible to my grade 12 mathematical education.
I confronted a professor about why they have it backwards and don't teach discrete math course or similar foundational course FIRST so people can actually read their textbooks, or at least let people take that path. They basically said that since it's not relevant to many majors and it's harder for most people since they don't have the 'mathematical mind' they do it in that backwards way. The professors being Math PhDs, don't adjust their any of their classes enough for the lack of foundational knowledge. It frustrated me very much. I don't think it's a big mystery why you probably hit that college wall when most college curriculums are set up that way.