Hacker News Reader

> Nicest: Andrew Ng, Machine Learning, Coursera. Interesting topic, well-planned material, very well avoids going into the mathy details, but still conveys a feeling of understanding of the topic, so accessible to a wide audience. (Martin Odersky, Functional Programming Principles in Scala, Coursera, was almost equally nice, but had some rough edges in the first run.)

Have to agree with all of this. I've taken Andrew Ng's Machine Learning course (only time I've paid for a 'verified' certificate), and found it a great overview of ML, though I'm not sure I'd feel comfortable telling anyone I have a good understanding of ML :)

Odersky's FP in Scala was actually the first Coursera course I took (during its initial run, I think). -- I also found the follow up Reactive Programming course to be excellent as well.

I too loved Odersky's course. It was definitely rough, but having the creator of a language teach a course about it provided insights that I wouldn't have gotten otherwise.

The Odersky's course is phenomenal. Highly recommended and it shows how much attention and craftmanship was put into designing Scala. Bonus: Martin speaks like Arnold and it's very enjoyable to have a "Terminator" voice teaching you complicated material.

I normally speed up his lectures to 1.25x. I love the lectures but 1.25 just sounds so good!

Agreed Ng's Machine Learning and Odersky's FP in Scala were my favorites. I'm looking for a good bioinformatics course at the moment. I wrote a small program for my daughter that attempts to find CRISPR sites for my daughter and it would be great to know more of the background.

Have you seen this before?

https://www.edx.org/micromasters/bioinformatics

The UCSD bioinformatics algorithms courses on Coursera are fantastic: https://www.coursera.org/specializations/bioinformatics

Interestingly, you took the same path I did with Scala and ML. My criticism about these courses is that some of the projects and content can be too easy to get right, skimming on the surface in some areas that would need more time to grok. Lately I've moved to Udacity and there I can find more in-depth projects and discussions with virtual classmates. The price is steep but you pay for what you are getting.

+100 to Andrew NGs machine learning. Inspired me enough about the potential of online education to start a (now reasonably successful edtech) company!

That's nice. Which edtech company is that?

I wish I enjoyed Andrew Ng's Deep Learning courses. For him being the cofounder of Coursera the production quality (audio/video) was pretty lacking. The whine/distortion on the audio made it difficult to listen to on headphones. Many of the exercises were either a bit too railsroaded and simple, or poorly explained in their goals and barely worked. I really didn't like his style of writing on the digital whiteboard. Perhaps just a side effect of a MOOC, but he never checks for understanding in even the most basic of ways.

While I'm not perfect, I spent nearly 3 years teaching at a bootcamp fulltime, so perhaps I have different standards for communicating and teaching actionable lessons?

> Jennifer Widom, Databases, Stanford. This is not the flashiest of a topic, but oh boy was it well organized.

Couldn't agree more. I took this course in 2011 but didn't have a need for working with databases until 2014. Three years after I took the course I was able to jump in and work fluently on databases -- Mongo, Sqlite, Firebase, etc. The least I can say is the course helped me internalize database concepts.

This course has the right amount of handholding yet challenges you enough so you acquire long-lasting skills.

Ditto. I was able to get my foot in the door of industry due to this course and Scott Allen's PluralSight C# courses.

I've now built 2 data warehouses and helped with maintenance on another. It's not my main focus, but it's nice to be able to do it myself when the work calls for it.

I got hired at my first job out of college due to the C# ones and I've been working in C# since then, with a smattering of other languages here or there.

+1 for Scott Allen

Chiming in with support of this course.

I studied portions of it before I got my first "real" tech job (not a call-center) and it put me on a path straight towards my career as a developer. I go back to the course every year or so and try to pick more gems out of it -- it's truly fantastic.

Is it this one?

https://lagunita.stanford.edu/courses/Engineering/db/2014_1/...

Yes there was a couple on Coursera but they scrapped it for God knows what reason. https://www.coursera.org/instructor/~1196954

Looks like it got broken up into smaller mini-courses available here: https://lagunita.stanford.edu/courses/DB/2014/SelfPaced/abou...

Main page: https://cs.stanford.edu/people/widom/DB-mooc.html

That was the first MOOC I took as well. It turned out to be an excellent entry point for databases. Perhaps because it was one of the first Stanford MOOCs, the quality of it was high.

This thread's full of really valuable information, so I've compiled these and a bunch of the other courses mentioned here into a big document[1]. I've also added quotes from this thread, with links back to the original comments.

[1] https://www.notion.so/MOOCs-recommended-by-Hacker-News-e1070...

EDIT: the previous link pointed to one of the headers in the page, instead of the page itself.

Andrew Ng's class was great! For a tougher class that focuses on one of the technologies, I recommend Geoffrey Hinton's "Neural Networks for Machine Learning" on Coursera. Really eye opening for me, and fairly close to the leading edge in deep learning, as far as I can tell. I felt that the exercises were more detailed and challenging than in Ng's class, and thus I ended up learning more.

> Probabilistic Graphical Models, Daphne Koller

– the first course in the specialization has a very good and engaging start, but the gap between lectures and problems widens quickly after that (maybe that's why the author boasts about a "challenging" course "not for everyone"). I'm hesitant to take the next course of the specialization.

I wrote about the first version when it was all in one course. It seems they have split it into 3 courses now. Probably it's less dense now.

I too took the first iteration, and it was... quite terrible.

The lectures were OK, but the homework was more than challenging. Not only had you to battle with the topic itself, but then you need to magically acquire knowledge in some totally unknown topic (I think it was genetics) and wrangle the quite baroque representation of that topic shoehorned in a programming language that is totally not made for it.

I was on the verge of despair because of those secondary problems. Really.

PGM was brutal... At Stanford straight As students were happy just to pass...

It's indeed dense and packed with many intermediate intuitions.

On the other hand, I still feel that the course is often unnecessarily brutal and could use better explanations.

MIT had a similar course on edX and that one was brutal as well (Computational Probability and Inference). I guess nobody figured out how to teach it the easy way.

I've been meaning to either take the course or read the book. I'm curious if you've read the book [0] and how you would compare or if you'd recommend one, the other or both.

[0] https://mitpress.mit.edu/books/probabilistic-graphical-model...

I read the book nearly cover to cover. I can't recommend it enough, but it's an enormous time and energy investment.

Thanks for the response friend, I think I'll order myself a copy soon and get working on that enormous time and energy investment. :D

Is PGM still relevant as it was five years ago, given the renaissance in deep learning and other NN techniques?

Yes [1].

[1] https://arxiv.org/abs/1801.04016

For me Bayesian networks are a tool of thought and I think it's worthy to learn them in the same way it's worthy to learn to sketch functions with pen and paper.

Checkout http://edwardlib.org/ and https://www.tensorflow.org/api_docs/python/tf/contrib/bayesf....

Also Bayesian Methods for Hackers: https://news.ycombinator.com/item?id=16482421

Yes, I think so. PGM or some improvement on that is relevant to doing things like reasoning correctly based on evidence.

I envision more sophisticated AGI systems to use DNN or other NN techniques to learn about the world, and be able to take in uncertain input and make sense of it. PGM or similar would then be used to correctly (in the mathematical sense) reason about what to do to accomplish the agent's goals.

Also graphical models are combined with deep learning techniques for SOTA performance in area like Named Entity Recognition.

FYI: This video on PGM by Bert Huang is pretty easy to follow: https://www.youtube.com/watch?v=zCWRTKnOYYg&index=20&list=PL...

> Nicest: Andrew Ng, Machine Learning, Coursera.

It's good to hear that this MOOC is still so well thought of since I first took it; for me, it was the first course I took that made me really understand how a neural network and back prop actually worked.

When I took the course, it was in 2011 - and was known as "ML Class"; yep - I was among the first "beta tester guinea pigs" of the course. It was fun and amazing to participate in.

One of the early participants was even inspired to replicate CMU's ALVINN self-driving vehicle in miniature:

http://blog.davidsingleton.org/nnrccar/

Pat Pattison, Songwriting, Coursera! I took this too! Fantastic! Delightful to learn something (anything!) from someone who so thoroughly and completely knows just what he has to say to teach a topic he's expert at.

> Pat Pattison, Songwriting, Coursera

This course gave me professor envy and made me up my game. So well done.

Yes, I enjoyed the Pattison songwriting class as well. At first his applying the "strong" and "weak" concepts to every aspect of a song lyric seems overly simplistic, but it actually starts to make sense. I came into class with considerably previous experience in writing poetry, but thought I learned a lot from him and my peers. His breaking down a performance coaching example was also very instructive.

Other music MOOCs I enjoyed:

The Berklee "Developing your Musicianship" series on Coursera taught by George W. Russell. Started off thinking this was too elementary, but the ear training is valuable, and I learned a lot about the use of diatonic chords, and even the few simple patterns he taught improved my song writing enormously.

The Berklee "Jazz Improvisation" class taught by Gary Burton. Very cool to be taught by a living legend, and his selection of songs was refreshingly modern. On the down side, skill levels of the students varied widely, so peer review was more miss than hit.

> The Berklee "Jazz Improvisation" class taught by Gary Burton. [...] On the down side, skill levels of the students varied widely, so peer review was more miss than hit.

100% miss for me. The main thing I learned from that course is that a "MOOC" relying on peer review for feedback is a colossal waste of time, and should have stayed as a video lecture series.

True, I did not learn much from the feedback. On the other hand, the existence of peer review might have pressured me into putting more effort into my exercises.

I concur completely with this assessment of Ng's and Widom's courses.

The coursera songwriting course is really great. Also Python for Beginners, the one that uses CodeSkulptor.

Do you mean "Python Programming Essentials"? https://www.coursera.org/learn/python-programming

That's it. In 2013 anyway, it was a good introduction to Python.

On the Pattison one, out of curiosity did it use his Writing Better Lyrics for the material? I've read the book and love it to pieces even though I write prose, the way he explores words and phrases is sort of magical.