Coursera course 'Fundamentals of Online Education' closed without warning
chewingthistles.wordpress.com
chewingthistles.wordpress.com
If an "expert in online education" is significantly worse in his/her own field than a biologist or mathematician, then I'd suggest choosing another, more suitable profession.
Similar sized and larger courses have been run many times for a year now - if you want to call yourself expert, then you should be at least a bit informed what worked/didn't work in these previous huge courses, and what approaches can't possibly work at that scale.
http://www.insidehighered.com/news/2013/02/04/coursera-force...
I was a bit frustrated that the process wasn't a bit clearer up front. And it does seem they haven't really figured out he huge class size issues yet. It does seem to me it woudl have been better to start out slower and work out some of the kinks but so much is done so quickly these days I am not really surprised they jumped in with both feet quickly (it seems to me).
The coursera effort really seems like a pretty audacious effort to me. Running into issues as they try to make it work isn't that surprising. I do think pulling the plug if things are really not working seems like the better choice than just pushing forward. Giving themselves a chance to regroup rather than try to just forge ahead seems like the better option. Granted not getting into the mess in the first place would be better but I'm willing to accept the idea that maybe they just ran into more problems than they imagined and just need some time to figure out alternatives before doing some great things in the future.
After reading I get the strong vibe that the instructors had online education experience in the context of the 20-person online classes that have existed at universities years before MOOCs. Then they moved into the giant MOOC pond thinking it would be the same. Unfortunately, they found out they were now small fish in the big pond of 40,000 eyeballs judging and crashing systems that previously worked smoothly.
In an average university, there are decent professors successfully teaching students a topic that they know, and have a bunch of years experience in teaching that topic.
But in a MOOC that is not enough - since a single MOOC can scale to almost all the world needs for that subject, there is no need for a thousand professors teaching the same subject, only the best ones. Some things are unavoidably "lost in translation" due to lack of face-time, but a great prof in a MOOC will still be better than the perfectly ok professor at your closest average university.
To do MOOCs the way they should be done, you don't need to "vet the instructor" in the way that teachers or professors are vetted. The quality threshold here is very simple - are you one of top 10 people in the world in your narrow subject area? If not, you don't need to apply.
The great MOOC courses I had were good only because the teachers were far more qualified than any professors teaching the same subject in 500 mile area from me, that is the value-add of MOOCs. The courses would not have been great if they were taught by simply a random good professor from a good university.
I can't resume videos from where I left, every video just opened for 1 sec. is considered 'watched', to close the video popup on iPad I need to play 'find a close button' game and overall the user experience of watching videos sucks a big way.
I agree, though, the video player overall is steps behind Youtube and others. I'd guess it's because they built their player from scratch (it being a core technology) and they have lots of kinds to work out to get it up to modern video player standards.
For me, the pause doesn't work properly if I pause for any significant time. If I pause the video for a minute, then everything is OK, but if I go to brew tea, then when I come back, the video always freezes after unpausing (well, it shows a couple seconds that were buffered) - probably they have some timeout issue there.
The fiasco with the MOOC class, IMHO, was probably avoidable.
For one MOOCs of the Coursera/Udacity scale have been around for little over a year and I doubt even Andrew Ng/Daphne Koller or Sebastian Thrun would call themselves experts in what a MOOC is. No one knows yet and we are in a transient phase while this new knowledge works its way though the academic environment. What MOOCs will be next year is very different from what they are today. So for someone other than a founder of a MOOC to teach a class on MOOCs raises some questions. Creating models of what a MOOC is while the area is in such flux only creates more noise in the channel. For another how is it a surprise that 40K+ people signed up, for any MOOC instructor at Coursera, let alone for a class on MOOCs.
It's unclear how Coursera let a class on this topic be offered not even counting the QA issues.
While OP raises many issues in the blog post about this class and the instructor there are similar patterns in many other classes.
MOOCs as they exist today are massively instructor/university/vendor centric. This is partly because they are an incremental step away from a university experience and instructors are leraning how to play in this new arena. Also because they are free and the value to the student just of the content and structure is huge. So the motivation to expend the effort ot make it additionally student centric is small. The current state of the art is more than good enough and will be for some time.
Even then there are somethings I have seen on Coursera which could be relatively easy to do and improve the experience for everyone.
There needs to be some sort of experience sharing forum for course instructors so knowledge sharing takes place. This seems to be missing as evidenced by comments in the first week by many instructors asking for patience as they work out the kinks and learn the ropes.
Specifically instructors need to have data on previous instructors' class experience - what worked what didn't. Maybe this is available but perhaps it's not being used enough.
Suggestions to instructors from what I see over the last year
* Think through your class requirements will it scale - this is not your university class on video - it's a massive beast that needs to be fed.
* Will it be secure on an Internet scale. For instance the absolutely excellent Data Analysis class by Jeff Leek of Johns Hopkins. He had to remove a requirement for people to submit executable R code in assignments bec it would run on other people's computers during peer-evaluation. Not criticizing this class but asking will future classes have this data point available to them? Not sure.
* any special things you need to do for your class (such as the Google spreadsheet usage in the class mentioned by OP) - has it been done before at the scale. Do you have TA's or support staff that have done this before? Pl. don't use the class as a scaling experiment.
* be available on the forums if possible or make it some TA's job to monitor all forums (not sure how one person could do this especially as the class progresses) Jeff Leek being live on the forums makes the class extra special.
* if possible create weekly video "screenside chats" like Jennifer Widom did in the very first online Intro to Database class from Stanford - they were excellent as were the Google Hangouts by Thrun/Norvig in the AI class. Andrew Ng's closing statement after his Machine Learning class was very deeply felt. While student centricness is not expected at this stage - communicating with students in this fashion makes your class much more engaging and you much more human. Also it's likely (wild ass guess) that completion rates might improve with this - worth investigating. I also remember emails from the AI class exhorting students not to give up. In contrast I have received emails from classes (not to be named) congratulating me on how awesomely I have done when I haven't even logged in once :-)
* as far as # of quiz attempts and using late days there is a wide spread of parameters across classes. My suggestion as a working professional is that 5 late days for say 8 quizzes and 8 assignments is not enough. In addition I found that a 4% penalty per late day was probably much more reasonable than a 50% penalty. Other than that 1 quiz attempt is too little but 100 is too many somewhere in the region of 5 seems more appropriate.
That's all for now - hope this is helpful.
TIL...
- Prof G and several of his TAs are in the forums. If you post a good or interesting question, they will show up and offer an answer.
- The class is incredibly complete: way more complete and self-contained than any other MOOC that I have tried. Prof B is incredibly knowledgeable and quirky to say the least.
- With the above said, the class demands a ton of self-study, but it is backed up with a lot of homeworks. Each lecture has a hw associated with it. They do have an attitude that you must struggle with the material and keep doing it over and over until you get the questions right and it starts to become second-nature. They pull this off by never giving answers to hw's.
- Despite the attitude with the hw, they have given amazingly complete answers to Exam 1 and Exam 2
- They offered a diagnostic exam before you start. This would let you know right away if this class will beyond your head.
- They really put some time into the class. The entire course is beautifully hand-drawn and I think the professor said that the drawings alone took 1200 hours or so. If you add in the Exams, hw, and the exam answers, there must be something like 1500 hours committed to making this course great.
I'm not entirely sure what to think of the grading:
4 Exams at 5% of the grade each Final = 80% of the grade.
I sort of like it because it gives you a bit of room to screw up and recover, but it is definitely shattering to do bad on an exam and start worrying about how bad the final may turn out. It is an interesting way to encourage you to take the work.
For this person to come in and try to push everything towards a student centric approach is... scary... Student interaction is what has traditionally had the most trouble scaling. Assigning teams via Google Docs wouldn't have worked for most large sized university classes, let alone a class of thousands.
Coursera now has a major issue: universities now understand that a publicly (spectacularly) failed course can tarnish the university's image.
I know a number of professors in academia and the university bureaucracy is what they're constantly fighting. The bureaucracy kills off innovation and hates taking risks. I fear many professors will not be allowed to teach from Coursera or similar MOOC platforms due to the possibility of damaging the university's public standing. This was already an issue before, considering these MOOCs don't directly benefit the university and could in fact be lowering their revenue (i.e. distance based learning).
The failure of this online course could have a far wider impact than just annoying 40,000 Coursera students.
1) Collect name, email address with Google form. 2) Run simple macro to assign to groups. 3) Sorted. As it were.