e-learning-ukr
22.2K views | +0 today
e-learning-ukr
Your new post is loading...
Your new post is loading...
Rescooped by Vladimir Kukharenko from Educational Technology in Higher Education
Scoop.it!

Instructional quality of Massive Open Online Courses (MOOC)

Abstract: We present an analysis of instructional design quality of 76 randomly selected Massive Open Online Courses (MOOCs). The quality of MOOCs was determined from first principles of instruction, using a course survey instrument. Two types of MOOCs (xMOOCs and cMOOCs) were analysed and their instructional design quality was assessed and compared. We found that the majority of MOOCs scored poorly on most instructional design principles. However, most MOOCs scored highly on organisation and presentation of course material. The results indicate that although most MOOCs are well-packaged, their instructional design quality is low. We outline implications for practice and ideas for future research.


Via Peter B. Sloep, Mark Smithers
Peter B. Sloep's curator insight, November 17, 2014 4:18 PM

For anyone with even the vaguest of interests in MOOCs, this is a particularly useful article (in Computers & Education) as it contains the data on an extensive survey of the pedagogical (instructional) qualities of MOOCs. The paper is relatively short and makes for an easy read. For those who want the main conclusions, here they come.

76 MOOCs were scanned, 50 xMOOCs, 26 cMOOCs, using an instrument that contains items derived from Dave Merrill's five first principles of instruction and five more principles derived from the literature more generally. Of the 72 points that any one MOOC that was examined could, none scored higher than 28. The xMOOCs ranged from 3 to25 points, the cMOOCs from 3 to 28. So the xMOOCs score negligibly better only, in spite of the widely held belief that cMOOCs are the pedagogically superior kind. Although the survey logs the situation in 2013, I can't imagine that in a years' time things have significantly improved. So by and large, the conclusions still hold. 

These figures then bode ill for the wild plans of the past that MOOCs can replace most existing universities (Sebastian Thrun), falsifies Daphne Koller's claim that Coursera MOOCs are built on sound pedagogical principles, and puts and end the wide-spread fallacy that elite universities necessarily breed top level courses. They corroborate claims made by Tony Bates, which I have echoed here and elsewhere, that MOOCs ignore decades of research in technology-enhanced learning, indeed in instructional design tout court. @pbsloep

Mark Smithers's curator insight, November 18, 2014 6:19 PM

Very interesting paper.

Mariano Rico's curator insight, November 20, 2014 8:43 AM
Back to basic formation design. We learn by doing
Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

Invasion of the MOOCs: The Promises and Perils of Massive Open Online Courses | Parlor Press

Invasion of the MOOCs: The Promises and Perils of Massive Open Online Courses | Parlor Press | e-learning-ukr | Scoop.it

Invasion of the MOOCs: The Promise and Perils of Massive Open Online Courses is one of the first collections of essays about the phenomenon of “Massive Online Open Courses.” Unlike accounts in the mainstream media and educational press, Invasion of the MOOCs is not written from the perspective of removed administrators, would-be education entrepreneurs/venture capitalists, or political pundits. Rather, this collection of essays comes from faculty who developed and taught MOOCs in 2012 and 2013, students who participated in those MOOCs, and academics and observers who have first hand experience with MOOCs and higher education. These twenty-one essays reflect the complexity of the very definition of what is (and what might in the near future be) a “MOOC,” along with perspectives and opinions that move far beyond the polarizing debate about MOOCs that has occupied the media in previous accounts. Toward that end, Invasion of the MOOCs reflects a wide variety of impressions about MOOCs from the most recent past and projects possibilities about MOOCs for the not so distant future.


Via Peter B. Sloep
Beth Dailey's curator insight, March 31, 2014 7:11 AM

Great collection of essays on MOOCs.

Theophilus's curator insight, April 3, 2014 3:49 AM

Great lessons to learn for our South African Higher Education institutions who are embarking on e-learning and online-course alternatives. We do not have to commit the same mistakes.

Paul Carey's curator insight, April 3, 2014 4:32 AM

The real story of moocs perhaps?

http://www.parlorpress.com/pdf/invasion_of_the_moocs.pdf

Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

MOOCs, Massive Open Online Courses, An Update of EUA's first paper | Michael Gaebel, EUA

MOOCs, Massive Open Online Courses, An Update of EUA's first paper | Michael Gaebel, EUA | e-learning-ukr | Scoop.it

With the rapid development of MOOCs, EUA (the European University Association) published an occasional paper in January 2013 on MOOCs for discussion at the EUA Council, and for information for EUA membership. The present paper aims to provide an update on these developments, particularly as they concern European higher education.


Via Peter B. Sloep
Peter B. Sloep's curator insight, March 11, 2014 4:59 AM

A year ago in MOOC land is almost ancient history. An update to the EUA’s previous report therefore almost reads as something entirely novel. The present version of the report covers several issues. It provides an overview of the well-known international MOOC facilitators, describes their specific characteristics and then goes on to inventory the European reaction to them. According to the report, about one third of all current MOOCs are of European extraction. It then wonders whether there is a specific European dimension to MOOCs and compares them with MOOCs around the globe. Business models are also paid attention to, an area in which the USA and Europe seem to follow a different course: where venture capital plays a major role in the USA, university initiatives and governmental involvement, including that of the European Union, seem to characterise European MOOC development. Then MOOC pedagogy is discussed, also with an eye on the impact MOOCs may have on higher education in Europe. It is of course this last issue which prompted the European University Association to commission the first and this second report. 

 

There seems to be a flurry of reports that take stock of where we stand with respect to MOOCs. When some claim that MOOCS  have passed the top of the hype cycle and are heading for the trough of disillusionment, reports like this are certainly useful for historical purposes. But for us now, who lack the benefit of historical hindsight, the present report can help to make up our mind about the direction in which we want to head with MOOCs. Do they spell they end of public higher education? Not according to Europeans, it seems. Are they the latest development in a move towards opening up educational resources? Perhaps, and more so in Europe than in the USA.  Are they a boost to the use of technology-enhanced forms of learning in higher education? For sure and everywhere! @pbsloep

 

Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

Completion data for MOOCs - Martin Weller & Katy Jordan, The Ed Techie

Completion data for MOOCs - Martin Weller & Katy Jordan, The Ed Techie | e-learning-ukr | Scoop.it

Completion rates is something that MOOC watchers on either side of the fence have been obsessed with from day one. In this blog post, Martin Weller publishes some data collected by OU researcher Katy Jordan on completion rates, in particular factors that influence them. Although a full paper is promised in due time, the preliminary results are already quite interesting. To mention a few, the median completion percentage is around 12%; the larger the enrollment (or the larger the number of active users), the lower the completion rate; the longer a course takes to complete, the lower the completion rate. Martin Weller then raises a few questions, tongue in cheek as the data are correlational only. However, it would indeed be nice to know if shorter MOOCs fare better in terms of completion, or if people get better at learning with MOOCs over time.


Via Peter B. Sloep
Peter B. Sloep's curator insight, February 6, 2014 3:17 PM

And then there is of course the question of whether completion matters. Martin raises that question too. The fundamental mistake is to compare a MOOC setting with a classroom setting, opening the gates to anybody even with only a remote interest versus a handpicked, in many respects homogeneous group of students who paid good money. Putting the comparison this way points out that the really interesting thing would be _not_ to find significantly lower completion rates in MOOCs.

The second mistake relates to an assumption that underlies many MOOC discussions: MOOCs are cheap, if they are as good as ‘regular’ courses, then they should replace such courses. That argument of course fails if completion rates are abysmal. The mistake here is that costs aren’t the only dimension in which MOOCs and regular courses are to be compared. Costs matter, but effectiveness (do people learn useful things, do they learn what they are supposed to) matters at least as much. I would suggest to contextualise discussions about completion rates by looking at  MOOCs as a means to some end. That implies that MOOCs for, say, continuous professional development need to be evaluated differently then MOOCs for Psychology 101. @pbsloep

Jon Dron's comment, February 6, 2014 3:37 PM
I think most MOOCs are cargo-cult courses: they look like courses, smell like courses, use what look like the same methods, but they don't achieve the same ends because courses cannot be considered apart from the contexts that surround them and the roles they play in the bigger picture. Without accreditation, commitment and the social and organizational norms and expectations of an institutional education context, they are not the same thing at all. It's like the original cargo cults and suffers from the same misconceptions: a cardboard airport with flaming torches marking out a runway is not going to make planes land. Jon Dron
Peter B. Sloep's comment, February 6, 2014 3:41 PM
;-)
Rescooped by Vladimir Kukharenko from MOOCs, SPOCs and next generation Open Access Learning
Scoop.it!

MOOC: Every letter is negotiable | Mathieu Plourde - blog

MOOC: Every letter is negotiable | Mathieu Plourde - blog | e-learning-ukr | Scoop.it
Just a visual representation of intepretations of what MOOCs are.

Via Peter B. Sloep, Learning Environments, Peter Mellow
Peter B. Sloep's curator insight, April 9, 2013 7:16 AM

Exactly what it says it is, but it nicely highlights the variety that underlies MOOCs and our talk about them (@pbsloep)

Ada Torres's curator insight, May 30, 2015 7:14 AM

un concepto dudoso y intrigante.

Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

Productive MOOCs | Colin Milligan - Learning in the workplace

Productive MOOCs | Colin Milligan - Learning in the workplace | e-learning-ukr | Scoop.it

Wouldn’t it be great if cMOOcs could be made more ‘productive’ – instead of advancing many people’s knowledge a little by re-creating the same (or similar) new knowledge again and again, can MOOCs be structured to stimulate the creation of new knowledge in a more coordinated way. Can you bring the learners together to produce something entirely novel as they learn? This is in the true spirit of connectivism.


Via Peter B. Sloep
Patricia Daniels's curator insight, April 8, 2013 2:40 AM

H817 students, this blog and Sloep's response are worth thinking about. It's something we can directly relate to within our own MOOC. Are you satisfied with the learning effect and production of knowledge? Are blogs and forum postings mainly reiterations or are novel ideas coming to the fore and being developed in further discussions?

Patricia Daniels's comment, April 8, 2013 2:41 AM
Thank you for this interesting response.
Peter B. Sloep's comment, April 8, 2013 4:03 AM
My pleasure ;-)
Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

Investigating MOOCs through blog mining | Yong Chen | The International Review of Research in Open and Distance Learning

Investigating MOOCs through blog mining | Yong Chen | The International Review of Research in Open and Distance Learning | e-learning-ukr | Scoop.it

Abstract: MOOCs (massive open online course) is a disruptive innovation and a current buzzword in higher education. However, the discussion of MOOCs is disparate, fragmented, and distributed among different outlets. Systematic, extensively published research on MOOCs is unavailable. This paper adopts a novel method called blog mining to analyze MOOCs. The findings indicate, while MOOCs have benefitted learners, providers, and faculty who develop and teach MOOCs, challenges still exist, such as questionable course quality, high dropout rate, unavailable course credits, ineffective assessments, complex copyright, and limited hardware. Future research should explore the position of MOOCs and how it can be sustained.


Via Peter B. Sloep
Peter B. Sloep's curator insight, May 2, 2014 8:53 AM

The introduction to the article sometimes paints perhaps too simplistic a picture (such as that the xMOOCs and cMOOCs exhaust the universe of possible MOOCs; cf my recent scoop in early March: http://sco.lt/8FAEJl) or a somewhat trite one (“MOOCs represents an emerging methodology of online teaching and an important development in open education.”). Still the article is an interesting contribution to  MOOC research for the methodology it employs: text mining and analysis of blogs on MOOCs. Language technologies - in this case concept analysis and mapping using leximancer - are a powerful means to crunch large amounts of textual data, often revealing patters that are not immediately apparent to the naked eye. The value of the article therefore does not lie in its introduction, but in the results and ensuing discussion. 

 

Chen summarises the results under the headings of benefits for learners, benefits for providers, and trends, concluding with a discussion of the limitations of his study. His conclusions are not earth shattering, but how could they? After all, this is a mere summary of what he came across in the 360 blog posts he analysed with the help of leximancer; it is not a position paper in any sense, at best it is a kind of meta-analysis. To put it differently, tongue in cheek, there’s no need to go through the 431 scoops I collected on these pages to get an impression of what has been discussed about MOOCs in blogs over the last 4 odd years. Read the article and you have a fair idea. And then you should go to individual blog posts to collect opinions. @pbsloep

Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

Trend Report: open and online education furthers quality and flexibility | Nicolai van der Woert, Ria Jacobi & Hester Jelgerhuis , Surf

Trend Report: open and online education furthers quality and flexibility | Nicolai van der Woert, Ria Jacobi & Hester Jelgerhuis , Surf | e-learning-ukr | Scoop.it

(From the foreword) The global development towards open education dates back more than ten years. In 2006, several Dutch universities followed suit with the publication of OpenCourseWare. Although several institutions had already embraced the concept of open education for some time, the issue seems to have truly taken hold in the Dutch higher education sector since 2013, largely due to the growing popularity of Massive Open Online Courses (MOOCs).

The Trend Report supports this conclusion. The report accurately describes the latest developments and challenges facing the Dutch higher education sector in relation to open and online education. The articles also outline a concrete vision on future developments, such as the effects of recognising MOOC results, the impact of digitisation on postgraduate education and other forms of disruptive innovation.

 


Via Peter B. Sloep
Peter B. Sloep's curator insight, March 11, 2014 5:51 AM

This is the third trend report in a row  that Surf, in which Dutch higher education institutions collaborate on educational innovation with ICTs,  has published. It features contributions by academics and support staff throughout higher education in the Netherlands, thus reflecting the current state of the art. Although the perspective is wider than MOOCed education, the term MOOC features 430 times, at least once on almost all of its 69 pages. It goes to show that in the Netherlands, but likely in Europe as a whole, there is an intimate link between MOOCs and open education. ‘Open’ here means making use of open licenses (such a creative commons licenses), it stands in contrast with ‘open’ in the sense of for free, without cost, which applies to the courses of the large MOOC platforms (see also the EUA report next http://sco.lt/6QxgvZ). 

 

As indicated, all the topics covered in the report refer to MOOCs. To name a few of them:  flexibility and quality, postgraduate education, apps for open education, economics of open education, platforms, recognition of credits, testing and assessment, MOOCs in formal education, learning analytics, student perspectives, privacy and other legal issues. As with the previous trend reports, a useful collection of insights. @pbsloep

Manuel León Urrutia's curator insight, March 24, 2014 9:18 AM

A trend analysis on MOOCs from all perspectives: institutional, educational, business, and technical. Interesting to see the insights of dutch scholars on how MOOCs can offer quality education, how can become sustainable business models. Of special interest is the second article about the potential of MOOCs to change education economics, supported with figures.

Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

University of London MOOC Report | Barney Grainger, U. London


Via Peter B. Sloep
Manuel León Urrutia's curator insight, March 2, 2014 12:28 PM

Another MOOC report, this time from University of London. Section 6 specially interesting for MOOC making. 

luiy's curator insight, April 15, 2014 6:21 PM

Project Planning a MOOC

 

The course teams involved with our MOOCs included experienced academics with familiarity in developing materials on a learning platform. Nonetheless, for each of them it was their first experience of MOOCs, as it was for the project planning team.

 

 

Delivering a MOOC

 

A range of styles and learning methods were adopted by the four MOOCs, appropriate to the subject matter covered. A MOOC structure of six weeks and 5-10 student effort hours per week of study appeared to be just right for the majority of students (55%). Some considerations for future delivery include:

 

< Well designed announcements at the beginning and end of each week that articulate with the topic coverage, learning activities and assessment methods can be effective at maintaining student interest and motivation.


< Management of forum threads and posts is a critical factor in dealing with massive scale short courses to ensure the majority of students are not affected negatively by the behaviour of a small number of the community, while preserving the openness of the discussion areas.

 

< The Coursera platform tools are significant and comprehensive in terms of plotting overall student activity, allowing evaluation of assessment data, as well as usage statistics on video resources and other learning activities; however, further refinement of these tools to enable both students and teaching staff to understand their progression at an individual level is necessary (and underway).



** Learning Resource Development


 


María Dolores Díaz Noguera's curator insight, May 20, 2014 5:22 AM

University of London MOOC Report .

I Barney Gracinger, U. London

Rescooped by Vladimir Kukharenko from MOOCs, SPOCs and next generation Open Access Learning
Scoop.it!

MOOC: Every letter is negotiable | Mathieu Plourde - blog

MOOC: Every letter is negotiable | Mathieu Plourde - blog | e-learning-ukr | Scoop.it
Just a visual representation of intepretations of what MOOCs are.

Via Peter B. Sloep, Learning Environments, Peter Mellow
Peter B. Sloep's curator insight, April 9, 2013 7:16 AM

Exactly what it says it is, but it nicely highlights the variety that underlies MOOCs and our talk about them (@pbsloep)

Ada Torres's curator insight, May 30, 2015 7:14 AM

un concepto dudoso y intrigante.

Rescooped by Vladimir Kukharenko from Networked Learning - MOOCs and more
Scoop.it!

MOOCs as community?? | Terry Anderson - Virtual Canuck, Teaching and Learning in a Net-Centric World

Here at Athabasca University we’ve finally begun serious talk about our approach to MOOCs. 

We are working through two models, trying to decipher the pros and cons of each or both. These are:

1 Run one of more of our own MOOCs, based in whole or part on our current online courses. In order to be a MOOC, the courses should be free and that creates some challenges. Obviously a revenue or substantial service model needs to be developed for sustainability.

2 Cherry-pick a few MOOCs, offered by others, and after asserting that they are equivalent to an AU course allow and promote students to challenge the course for AU Credit.


Via Peter B. Sloep
Peter B. Sloep's curator insight, April 9, 2013 4:28 AM

Dedicated distance teaching universities ('open universities') arguably have always been in the MOOC business even though it did not go by that name. As to massiveness, it always has been their intention to achieve economies of scale by investing much effort in the design of a course and little in their deployment (that is, lecturing, tutoring, etc.). Similarly, they always have intended to be open, though not so much in the sense of having free enrolment, but much more in the sense of eliminating formal access thresholds and leaving it to the student to decide on the pace, place and timing of their studies. And, indeed, many are also involved in experiments with Open Educational Resources, struggling with the same sustainability question that the xMOOC platform providers: if you provided the content for free, where does your revenue stream come from? And finally, although most started off with correspondence learning as their teaching model, these universities were the first to see the opportunities online learning offered and have experimented with it even before the Internet took off.  However, none of them achieved the massiveness that current MOOCs do, none of them offered content fully for free. But then again, none of them could feed of the lavish kind of funding venture capital (or rich alumni) have made available to the current MOOC platforms. 

 

In the face of the MOOC craze, distance teaching universities have also started thinking about the question of where they fit into the higher education landscape, of whether business remains as usual or they should adapt. Terry Anderson addresses this question in his blog post and comes up with tow models: keep on doing what you have been doing thus far, but relabelling it as MOOCs and making a few changes; or getting into the business of assessing and crediting prior learning. In the first case, you remain a genuine university, in the second you specialise in only one service that universities offer. Terry doesn't make a choice, wisely so, it seems to me. The two alternatives do not exclude each other, nor do they exhaust all the options. So you could do both or invent yet other kinds of responses. One would be to work with a mixed services model: the basis content is free, you may acquire access to peer tutoring for a small fee and to personal tutoring by a teacher for a large fee,  you may acquire access to the exam for a fee and receive credits for a larger fee (as this requires that the exam be assessed by a teacher), etc. But there are no doubt other options to be explored.

 

Distance teaching universities should really seize the opportunity to advertise themselves, now that MOOCs have put online learning in the public eye. Actually, because of their historical development, they are in a much better position to address the challenges posed by the for-profit MOOCs than traditional universities. (@pbsloep)

Rescooped by Vladimir Kukharenko from MOOCs, SPOCs and next generation Open Access Learning
Scoop.it!

MOOCs on the Move: How Coursera Is Disrupting the Traditional Classroom - Knowledge@Wharton

MOOCs on the Move: How Coursera Is Disrupting the Traditional Classroom by Knowledge@Wharton, the online business journal of the Wharton School.

 

Comment: good, sensible interview with Coursera's Daphne Koller, about the difference between xMOOCs and traditional education, about credits and certificates, about (peer) assessment, about the business model. Intesting is her toned-down prediction for where Coursera will be in 10 years time: 

"I also think that in five to 10 years, from the perspective of the higher education ecosystem, people will look back on the 20th century and say, "I can't believe that we spent so much of our students' time shoveling them into auditoria and having them sit there for 75 minutes while somebody lectured at them." We will all clearly recognize that this is not the best form for getting people to learn material and use it effectively. I think our notion of what makes for a good education will shift drastically.

That's right, at least I hope, but that was not the question. I would have loved to hear what she thinks Coursera's or for that matter the MOOCs' role will have been in this. For if we let people watch the sage on the stage through a computer screen rather than in an auditorium, nothing has fundamentally changed. And that is what we need. And there may be room for MOOCs then, or not. (peter sloep, @pbsloep)


Via Peter B. Sloep, Peter Mellow
No comment yet.