newsoul

Choose Your Weapon: Survival Strategies for Depressed AI Academics

https://arxiv.org/abs/2304.06035

Then, where to read more about this? People who built autograd and other frameworks like Pytorch, mxnet, etc. should have learnt them in details somewhere. Where? AFAIK mxnet came out of academia (probably CMU).

Which book was used in the course?

Here is the twitter thread about it: https://twitter.com/ShriramKMurthi/status/166987750603426611...

Surprised to see these introductory courses haven't been mentioned yet.

These courses [0] [1] are on EdX and are taught by UBC Professor Gregor Kiczales. The explanations are so lucid it made recursion click for me. You can audit these courses without paying a single dime. They are based on the book How to Design Programs [2] which has much more stuff than the courses.This book is used in UBC, UWaterloo, NorthEastern and many other places.

Along the same lines there is another book for beginners called A Data-Centric Introduction to Computing [3]. It is used in Brown for their introductory courses.

[0] https://www.edx.org/course/how-to-code-simple-data

[1] https://www.edx.org/course/how-to-code-complex-data

[2] https://htdp.org/

[3] https://dcic-world.org/

How to Code: Simple Data [0]

How to Code: Complex Data [1]

These two part course rearranged my brain about what really programming is about. It is about working with data and the way the data is arranged determines how most of the program/functionality (pun intended) is written.

Programming is not a series of instructions to be executed by the computer. That was when assembly language programming was the main stay of programming computers. Not now.

[0] https://www.edx.org/course/how-to-code-simple-data

[1] https://www.edx.org/course/how-to-code-complex-data

Do you know any books which teach matrix calculus?

I have learnt programming from the books "How to Design Programs" @ https://htdp.org/. It is fantastic. It sets in stone the good practices early on.

I will go with the book option:

Introduction to Algorithms: A Creative Approach by Udi Manber

I feel pure joy when I see HtDP mentioned anywhere on HN. This book made programming click for me. Turned me from fidling with code to thinking it through in a systematic way.

I hope the authors extend this someday to imperative programming too and compare and contrast.

I wouldn't mind if you write some more about the book.

But is that suitable for a beginner?

You can try out fast.ai's courses.

Also there is a youtube series by Andrej Karpathy that goes into much more detail and builds a library from scratch.

Can you share the link to your youtube channel?

I have done my bachelors and masters in electrical and communication engineering. I know calculus, matrix algebra and prob stats on a level of engineering. Not in much depth.

Why?

Would love if you could name some books that teach like that, since we can't get you as a teacher.

Yes, I love recursion. Haha!

Fantastically put into words!!

I hope more and more instructors create such high quality content and put it online for the world to collectively learn and create a better place out there.

I find many instructors in upper level courses do this. But for introductory courses, most materials are locked in. I don't understand why? Only MIT seems to do this consistently (they have huge amounts of money, it seems).

Another such course is : https://cs3110.github.io/textbook/cover.html. Still upper level.

A set of lower level core courses like intro to programming, intro to low level programming, discrete math, algorithm design, etc. will totally change the game. More and more people would be interested in upper level courses then and we would get more researchers and practitioners in the field to march forward.

Objects are nouns

Functions are actions/verbs.

I think he worked for Samsung : https://www.pranavmistry.com/

This book is good. But not as good as the previous book by Shriram Krishnamurthi : https://htdp.org/

The only positive point I see in this book is that it is less formal (or set-theoritic as the authors call it) than How to Design Programs and uses a typed language Pyret and an online IDE.

Both of these are readable code to me:

1. https://norvig.com/spell-correct.html

2. https://norvig.com/sudoku.html

SICP. When do you recommend software devs read it? Beginning of their journey or mid journey?

Can you provide a link to the syllabus?

Nice. This is the type I was asking for. Projects that give you joy and you don't care what the world thinks about it at large.

Yes, updated second part of the course when? Any chance you will shift from Swift to Julia?

Hello Jeremy. Thanks for this great content. I have gone through your entire course and learned a ton from you.

Now moving on from here, do you have any resource recommendation where I can dive deeper into machine learning and deep learning theory? And also any resources to become a much much better programmer?

I am currently working in as an assistant in a research lab. My coding skills are not that great.

Here is a course (with videos) based on HtDP 2e: https://legacy.cs.indiana.edu/classes/c211/index.html