Sharing recent experiences with the massive open artificial intelligence course developed and conducted by Stanford faculty Sebastian Thrun and Peter Norvig.
In the last decade, the Creative Commons philosophy of freely sharing information and the pervasiveness of the Internet have created many new opportunities for teaching and learning. MIT OpenCourseWare spearheaded the sharing of high-quality, university-level courses. While these materials were not originally designed for individuals engaged in self-study, approximately half of OCW's traffic is from these users.6 Recently the use of learning management systems (LMSs), such as the proprietary Blackboard or open-source Moodle software, has become ubiquitous.
In typical use, LMSs support the structure of conventional courses in an online setting. Lectures and reading material are assigned, homework is scheduled, and discussions are facilitated at regular intervals. As in conventional coursework, classes are usually closed communities, with students registering (and paying) for credit-bearing coursework.
One of the first initiatives to bring together open course philosophy and LMSs was David Cormier's "Massive Open Online Course," or MOOC. In his vision, "Although it may share in some of the conventions of an ordinary course, such as a predefined timeline and weekly topics for consideration, a MOOC generally carries no fees, no prerequisites other than Internet access and interest, no predefined expectations for participation, and no formal accreditation."9
This ideaalbeit in a more conventional course structureexploded into the public consciousness with the massive open artificial intelligence (AI) course developed and conducted by Stanford faculty Sebastian Thrun and Peter Norvig last fall. Announced in the summer of 2011, the course received wide publicity, and attracted about 160,000 registered students by its launch in October 2011. Approximately 23,000 students completed the 10-week course.8 I was one of the 23,000along with a cohort of 16 students, both graduate and undergraduate, from my home institution (the computer science department at the University of Massachusetts Lowell).
Since the fall AI 2011 course, there has been much activity in this space. Thrun has set up a for-profit company, Udacity, to extend his initial work; Stanford and others are running courses using Coursera; MIT created MITx and is partnering with Harvard on edX; and there are other initiatives.4 The remainder of this column describes my experiences taking the fall 2011 course alongside my students and facilitating their learning. This is followed by some reflections. It seems likely this new breed of MOOCs will have impact on education at the university level, particularly for technical majors such as computer science.
The Stanford course consisted of weekly lecturestwo or three 45-minute topics that were broken up into 15 or 20 short videos. Most of the individual videos had embedded questions (multiple-choice or fill-in-the-value). At the end of each mini-lesson, the video image transformed into a Web form where students fill in answers. Already logged in, the class server graded the students immediately. After submitting, students were shown an explanation video.
The lectures themselves were inspired by Khan Academy's casual, teacher-sitting-by-your-side approach. Occasionally, Thrun and Norvig trained the camera at themselves, but the core content was conducted with the camera aimed at a sheet of paper, with Thrun or Norvig talking and writing in real time. I found this format relaxing and engaging; I liked seeing equations written out with verbal narration in sync.
There were weekly problem sets with the same format. These homeworks tracked the lecture material closely. The course included a midterm and a final with the same format as the homework. If you worked through and understood the problems embedded in the lectures, the homework assignments were straightforward. The homework, midterm, and final each had hard deadlines. The server backend kept track of students' scores on the homework assignments, the midterm, and the final, which all counted toward the student's "grade"a ranking within the active student cohort.
Thrun and Norvig were strong teachers. They thought through excellent ways of explaining the ideas and quizzing the in-lecture comprehension checks. They often brought fun props or showed research projects in the video recordings.
Thrun and Norvig were only a week or so ahead of the course delivery, and they paid close attention to students' progress. There was a lot of activity on the Web forums. They recorded several "office hours," where students submitted questions and voted on their favorite ones, and then they picked questions and answered them on camera. In this way, the course was like a typical classit was not "canned." Thrun's and Norvig's enthusiasm was infectious. Collectively, the real-time nature of the experience made it a lot like a well-taught conventional course.
Students registered for my department's regular AI course, which requires a project. They knew when signing up that I expected them to complete both the Stanford course and a directed project. As mentioned earlier, I had 16 students. We met once weekly for a 75-minute session in a roundtable format. We talked about the Stanford material after each week's assignment was already due. Because of this, I did not have to present the course material in a lecture format. When we met, most of my students had worked through the lectures and the homework. So I did not have to explain things to students for the first time. Instead, we used in-class time for conversations about material that people found confusing or disagreed upon. We had some great discussions over the course of the semester.
A similar approach was developed by Day and Foley in their HCI course at Georgia Tech.2 They recorded Web lectures, and then used classroom time for hands-on learning activities. Daphne Koller, a colleague of Thrun's at Stanford (and founder of Coursera), has called this "the flipped classroom." She reported higher-than-usual attendance in her Stanford courses taught this way: "We can focus precious classroom time on more interactive problem-solving activities that achieve deeper understandingand foster creativity."7
The success of the fall AI course and the bloom of new ones this spring and summer puts real pressure on conventional, lecture-and-test university instruction. Thrun is quoted in several reports as noting that attendance at his face-to-face AI course at Stanford in the fall dropped precipitously. From the 200 registered, after a few weeks, only 30 continued to attend.8 But this really speaks to the failure to have the in-person time deliver anything different from a lecture. In many ways, the carefully crafted online lectures, peppered with probing questions that are autograded for correctness and then explained further, are indeed an improvement over a conventional lecture.
There are many initiatives to improve the quality of face-to-face time in lectures. When used creatively, clickers can be a valuable modification. But more fundamentally, active learning approaches hold much more promise.
Robert Beichner has developed a classroom approach called "SCALE UP" for active learning in the classroom. His work started in physics education, but years of development and collaboration broadened it to many fields, including the sciences, engineering, and the humanities.5 In SCALE-UP, faculty engage students in a structured activities and problem-solving during classroom time. Students work in teams of three, and faculty mingle with them, engaging them in discussions. (The SCALE-UP acronym has had several meanings, including "Student-Centered Active Learning Environment for Undergraduate Programs.")
Eric Mazur, also from the physics education community, has developed a related approach that he calls "peer instruction," in which students work in small groups to answer questions posed in lectures. Like Beichner, Mazur is active in disseminating this method.
However, dissemination and adoption are big challenges. These approaches require substantial new development of the problems and activities with which students are to be engaged in the classroom, and teachers must give up their carefully crafted lecture presentations.
Also, teachers need to be protected from low student evaluation scores. Mazur and others have reported that students give lower evaluations in courses with active learningeven when the evidence shows they have learned more.1,3 Students have grown up with conventional lecture teaching, and just like anyone else, they are resistant to change.
Beyond this, faculty must participate in these active learning approaches as learners, so they understand how to facilitate them as instructors. In my case, in my graduate training I learned how discussion-oriented seminar courses are conducted, so it was natural for me to facilitate the same with my small group of "flipped classroom" AI students.
When Thrun was promoting the fall 2011 online AI course, his Twitter feed included some bold claims: @aiclass: "Advanced students will complete the same homework and exams as Stanford students. So the courses will be equal in rigor."September 28, 2011
The fall 2011 course for matriculated Stanford students included programming assignments, and the online one did not. This was a clear shortcoming. But the new Udacity courses include programming. Most of my students got a lot out of the fall Stanford courseand our weekly discussion sections made a difference. But the weaker students struggled, and a few strong students were bored. This makes me wonder about the large-scale applicability of the MOOC format. We need to be able to support students who are still learning how to learn, and also challenge our best students. The MOOC concept does not even attempt to address the role of a small, research-oriented project-based course. When we individually mentor each student on his or her own ideas, we are doing something that can never be performed by an autograder.
Part of the excitement around MOOCs is about their potential to change education's cost equationput a great course online once, and run it unattended many times. But part of the fun of the fall AI course was that Thrun and Norvig were right there with us, and that we were a large cohort of students there with them.
Thrun also asserted: @aiclass: "Amazing we can probably offer a Master's degree of Stanford quality for FREE. HOW COOL IS THAT?"September 23, 2011
As we know, the modern university is a much larger ecosystem than its collection of courses. Among many other things, students derive great value from being in close contact with their peers, participating in leadership opportunities across campus, and being part of our research labs. It may well be that this new breed of MOOC is a decent replacement for an average, large-sized lecture course. But this is a low bar.
In our drive for efficiency, we must aspire to higher than this. At least, we can use MOOCs to create a successful flipped classroom. We can use our "precious classroom time" for meaningful conversations. As Mazur and Beicher have demonstrated, this can be done even in large lectures by having students work in small groups.
At best, we can really add value, by being teachers. We can individually debug students' thinking, mentor them in project work, and honestly be enthusiastic when they excel.
9. McAuley, A., Stewart, B., Siemens, G., and Cormier D. The MOOC Model for Digital Practice. 2010; http://www.elearnspace.org/Articles/MOOC_Final.pdf.
The Digital Library is published by the Association for Computing Machinery. Copyright © 2012 ACM, Inc.
With all due respect to the author, and noting that the text offers a reasonably favourable opinion on the MOOC issue, I have to say that this is yet another in the long series of articles taking an extremely narrow, US-centric, academia-blinders-on view of the matter.
Thousands, potentially millions of students from around the world now all have access to educational materials of extremely high quality compared to local standards. Comparing Coursera, Udacity or EDx experience to a Standford classroom experience might be a fine intellectual exercise and all, in an ivory tower, head-in-the-clouds kind of way. But for a huge fraction of online students Stanford classroom is not an option, and will never be. Financially, geographically, and in terms of time commitment needed to obtain a college degree.
And if you compare Prof. Thrun lectures (or most of the classes offered by Coursera, which seems to be extremely good at finding passionate, gifted and all-around awesome teachers) to your average CS class in North Elbonistan's top school... Well, let me tell you - and I'm speaking from personal experience - that the latter is not even within a shouting distance.
Surely, there are good teachers everywhere. And just as surely, one can study a subject productively under almost any circumstances, as long as one has a decent textbook available and sufficient motivation to learn. But I've yet to see an MSc CS from my country who would known what a fold is, and I interviewed several dozen of them in the last few years. The word 'catamorphism' makes them outright catatonic, I kid you not. Many of those had LISP on their resumes.
This might be in part due to the devolution of the higher education system into a machine for rubber-stamping the raw material for the ever-hungry IT job market. But I submit that simple deficit of quality educational substrate is a major factor too. A good friend of mine (a young but brilliant practicing software engineer, I should mention) has a long-standing interest in DSP. But he couldn't find a class in that at his school back when he was getting his BSc. He studied on his own, and keeps studying to this day. But let me tell you that he jumped with joy when I told him Coursera is planning to offer a DSP class from EPFL this winter.
The MOOC trinity may or may not compete with Stanford et al. But that's completely beyond the point for most of their students. Open your mind a little already. The world doesn't end at the walls of your campus, and MOOCs are about the world, not about the lucky few who got on the inside of those walls.
Displaying 1 comment