Introduction to Deep Learning (CMU)

I remember taking this course at CMU, I had no knowledge of deep learning before this course. After this course, I had trained over 75 models in the assignments, implemented a pytorch backend and a significantly large course project that I was confident to launch my career in Deep Learning. Cannot recommend this course enough, you need to do all the assignments to get maximum value out of it and it can be intense. But think of it as a bootcamp for machine learning. I still find these course materials useful in interviews.

>You will need familiarity with basic calculus (differentiation, chain rule), linear algebra, and basic probability.

So if I'm at the point that math skills, rather than programming skills are my barrier to interesting courses like this one, does anyone know of any good resources? I don't seem able to teach myself calc from a book like I did Python.

I took this course the first semester it was given. There was one TA, and now there's 24! Fun fact: The TA was the writer of Aqua's 90s hit "Doctor Jones".

I am a 1year experienced software engineer in a small company. I have been learning Machine Learning recently for company's project. Do you recommend me this course? I want to learn the concept systematically.

The most valuable part is the assignments and homework. If possible, where can I find the code?

I think for someone who hasn’t seen the material at all before it would be a lot for a semester. They don’t know what backpropagation is but by the end will understand a diffusion model? It’s ambitious, I think.

The other thing is this seems to be very CNN heavy. Four lectures on the topic seems like a lot.

Also, I don’t see embeddings explicitly mentioned as a topic. They’re a huge component of industrial research, and creating good embeddings and retrieving them quickly is a topic I feel students should also be exposed to. (Yes, they mention “representation” with autoencoders but quite frankly the code bit is generally not useful for similarity metrics.)

Finally, it would be nice to expose students to multimodal learning. Something like CLIP would be pretty neat to expose students to. It’s a great insight when you realize that you can train projections of multiple modalities into a shared high dimensional space. If they’re going to cover diffusion models certainly complexity isn’t a concern.

It is not clear to me if people who are not CMU students can get their assignments/quizes checked by the autograder.

There’s a Giant Eagle auditorium in Baker Hall?

in person or remote? open sourced like MIT or closed source? no details are mentioned whatsoever