Learning Locker: The Open Source Learning Record Store

Today we announce the new version of Learning Locker. If you’ve looked at Learning Locker before you will notice that we’ve changed. We haven’t lost sight of our original ideas, we’ve just changed our approach. Learning Locker will become the first enterprise-ready Learning Record Store to be available completely open source. Here’s what we’re thinking…

Turns out, owning your learning data is dull

We’re passionate about promoting individual ownership of learning data. This is the beta product we originally built, a way to capture and present your learning data using xAPI. The idea was, and remains, a cool one. The problem comes in the capture of this data. If you look at really successful personal data solutions, like Nike+, you see how much work they put in to making data capture seamless. Hence the Fuelband. This is a smart solution – slap it on your wrist and all the stats is done for you.

With our original Learning Locker we couldn’t ever quite crack this problem. It was fundamentally too much work to manually capture your data, or to try and re-direct an xAPI endpoint to your own learning locker. Most products aren’t yet built in a way that is compatible with this approach. The payoffs of owning your learning data are long term, so putting in a lot of short term work just wasn’t compelling as an experience. It was a bit dull.

Enter the Learning Record Store

Previously, whilst we adopted the xAPI, we weren’t conforming to the standard for a Learning Record Store. To be honest we didn’t need to do it because we were a consumer facing product that was designed to be a step removed from an LRS. But in our reflection on the personal data problem we came to the conclusion that the most obvious way to automate the process was to also tackle the ownership problem at the organisation level. If we could build a platform that was good for companies to manage their learning data, it would be a lot easier to configure individual user services off the back of that. If a company was doing the leg-work in collecting the data, all the individual would need is a pass-through on the feed. Kinda how you might connect Twitter and WordPress together.

This would mean a turnaround in our strategy; no organisation would adopt an xAPI solution that wasn’t 100% compliant with the standard. We would have to become an LRS. This wasn’t a trivial decision. Writing a fully conformant LRS is a big undertaking.  At this time I only know of two other commercially available LRS platforms; Watershed and Wax. But after a lot of thought, Dave and I decided it was the best way forward.

Learning Locker – for real this time

Which brings us to today. Dave has been plowing through the xAPI specification for the last two months, refactoring our code to bring it up to scratch. We’ve faced a lot of tough decisions along the way. One of those was about focus. We couldn’t bring both the organisation and the individual parts to market at the same time. We chose to concentrate on the organisational elements first, figuring that if we could get data collection going here first, we will have a nice base of statements to push out to individuals when the time is right.

Of course, we had previously committed to open sourcing our work. This is an approach we wanted to keep. As such I’m delighted to announce that Learning Locker will be the first open source (GPL 3.0), enterprise ready Learning Record Store to make it to the marketplace. In fact we’re already in place with 4 pilot organisations.

Now the really hard work starts. Open source isn’t just about giving away code. It’s about fostering a community that can build on our base and support growth. That’s why we’ve set out the building blocks of a governance plan and been around the world recruiting the best and the brightest to come help us out. We’re delighted to have people like Megan Bowe and Aaron Silvers on board to help shape our community approach. And we’ve got great support from the UK in the form of Jason McGonigle and Bryan Mathers. We’ll be adding to our board in the coming weeks, so keep an eye out.

We are completely committed to making learning data work for individuals. This means ownership as well as services. It might take us a little longer to get there but now I’m completely confident we’ll arrive at our destination. In anticipation of us launching Learning Locker please sign up to our mailing list. We’ll use this not only to announce the launch but to keep people up to date with the project on a monthly basis. Check out our first meetup times and if you are in the area please do come and join us.

This is going to be fun.

, , ,

No Comments

4 Ways to use Curation in Learning

I’m getting very excited about the possibilities of using more digital curation in learning.  The trouble with curation is that I’m seeing it everywhere. As such I wanted to come up with a short framework that I could use to talk about how I see curation in learning being used, both at the organisation level and for individuals.  So, go easy on me; here’s what I’m proposing…

We can think of digital curation as being useful to us in four broad roles that I’m calling Inspiration, Aggregation, Integration and Application. Inspiration is how I term curation that is done by other people on your behalf, outside of a formal learning environment.  Aggregation is the same thing, but done within a formal learning context.  Integration is a more personal curation process; how individuals blend new learning experiences with existing thoughts.  And finally Application is how individuals apply new insights in the real world; how we individually manage knowledge on a day-to-day basis.  I capture this flow in a simple matrix that demonstrates how the four types of curation can flow into each other in a continuous learning cycle:

Inspiration, Aggregation, Application, Integration

Inspiration

With the proliferation of content on the Web, it should come as no surprise that we are in increasing need of systems to sort, maintain and re-purpose content in a systematic manner. For a while now we’ve been making do with search as a primary means of sifting through the pile.  But increasingly we are turning to named experts to act as our filter to content.  Where these experts spend time storing, transforming and sharing resources with the world, they are in fact playing the role of the curator on our behalf.  These experts have appeared in every industry. In our own industry content curators are plentiful and many have become well known for their curation efforts.  Chances are that if you’ve attended a conference in the last 3 years, you’ve benefitted from the backchannel curation skills of David ‘LnDDave’ Kelly.  Kelly stores an event’s tweets, blogs and presentations and brings them together on one webpage for easy reference.  By following curators like Kelly we can draw inspiration from a set of content that we know is going to be relevant to our work.  It’s like being hand-delivered the best insights into an industry, straight to your mailbox.

Organizations can of course benefit from this approach.  Here, the role of the digital curator is that of a guardian of resources; someone who stores, transforms and shares within the context of the strategic needs of the company.  Some companies do this internally; curating insights onto social intranet pages or moderating communities of practice for the best thoughts.  Others do it externally, for the benefit of their customers.  Companies like Spiceworks, the IT support company, base their business model around their community, from which they curate the best questions and answers to help promote a collaborative and consistently helpful service.

Aggregation

Increasingly we are being challenged to deliver ‘more with less’ in the learning department.  Curation potentially holds an interesting answer to some of the constraints we’re facing in time and cost. Why build new content, when you can curate?

In the context of a formal learning intervention, organizations can use curation to aggregate content as part of the learning design process.  This can mean using insights gathered from both inside and outside the organization as a baseline of content from which to develop new courses. Sometimes these resources will be re-written and transformed; other times it is enough to use the resources in their original form.  With the increasing quality of online educational content, it is becoming somewhat redundant to always make new material.  You aren’t going to make a ‘better’ TED video than the real deal. It is no longer necessary to create new learning content each time a demand passes down the line.  Blending resources from the outside world with a selection of resources from within the firewall can increase your speed to delivery and cut costs dramatically for the L&D department.

Taking this further, some organizations are beginning to advocate a ‘resources not courses’ strategy.  Here L&D looks beyond providing highly structured courses and towards individual resources.  BP adopts this approach. Lead by Nick Shackleton-Jones, Director of Online and Informal Learning, BP focuses on producing high quality performance support tools, videos and infographics, delivered through simple but effective portal-type websites. They do not develop traditional courses at all; the aggregation and presentation of resources has proven to be far more successful than any previous course ever was.

Integration

Curation can and should be used as a tool of teaching and learning itself.. It is not enough for us to simply present content and imagine that it will be so compelling that our audience will instantly change their behavior.  The learning process is a complex one that, especially in experienced learners, requires a process of integration between new and old experiences.  In many ways when we seek to ‘teach’ people, what we are really seeking to achieve is ‘integration’ between old and new experiences.  For most individuals, this will be a process of curation; storing ideas, transforming them to fit with existing experiences and mental models, and, at some point in the future, sharing them through behavior.  Thought of in this light, we can suggest that curation is a key part of the learning process, a key digital literacy that will be required for all current and future knowledge workers.  It is not enough to be told; that’s grade school stuff.  In the current working landscape it is constantly necessary to problem solve and innovate.  That requires critical thought.

Taking this approach, we can seek to produce pedagogical frameworks in our formal learning activities that encourage individuals to cast a critical eye over knowledge, and to be more reflective in their approach to learning. In these circumstances, learners articulate their grasp of a subject area by storing, transforming and sharing their understanding.  If we don’t allow for these processes, we are short-changing learners.  Static, anti-social online learning activities are repeat offenders here; presenting an experienced learner with an online PowerPoint presentation and expecting them to have a meaningful, lasting learning experience simply isn’t going to cut it.  Learners have to be able to curate formal learning to integrate new insights with existing experiences, and to demonstrate back to you, the teacher, how they are going to change.

Application

Moving beyond the classroom and into the world of day-to-day work we can envisage curation as a tool of continuous personal learning.  Here curation helps individuals to capture information that is important to them and to wrap it in a context that gives more meaning than the message alone would impart. Many of us do this in blogs, in tweets and in other collections of knowledge that we share with the world. Increasingly we are seeing the rise of this concept in the form of Personal Knowledge Management (PKM; see Harold Jarche’s website for more information).  According to Jarche individuals seek, sense and share as they seek to explicitly state their understanding of the world.  This process could be seen as the fundamental driver to user generated content – more and more people are willing to share content to inspire others.  This process is more than just bookmarking or collection building.  For many individuals, their curated insights represent a ‘learning locker‘ which  allows for reflection as well as a demonstration of what they know.  It is these individuals that seed the world of content that organizations often seek to curate. And so as we encourage the adoption of PKM tools and techniques, so we see a rise in the overall amount of content available for curation. The cycle begins again.

Summing up

Curation comes in many forms, even within a small niche like learning and development.  We can use it an organizational level to help inspire our employees and our customers, or to help us design and deliver more formal learning experiences using a wide range of content.  We can use curation at a personal level too; to help us develop our understanding in a formal learning process and to help us demonstrate our knowledge and insight from our day-to-day work.  Truth be told, it is early days for curation in our world. Whilst the practices are old, the technologies are often new and as we get to grips with the possibilities that new technologies bring us, it’s easy to see that more opportunities for storing, transforming and sharing resources will become apparent. Curation, as a skill, is on the verge of becoming a key differentiator for employees; knowledge workers could well be expected to bring their curated insights with them to their next job role.  People are making names for themselves as industry experts by the ways in which they curate other people’s work. Telling a story like those I find so interesting at the Natural History Museum is most certainly a skill, but increasingly, it is becoming easier for each of us to become the curator.

Extracts of this article are included in the forthcoming ASTD Handbook (2nd edition); “Curation of Content”.

Want to know more about digital curation? Sign up for our mini-MOOC “How to be an effective digital curator” here.

1 Comment

FutureLearn MOOCs; the future of learning?

This week saw the launch of FutureLearn’s first course, The Power of Brands.  FutureLearn is the UK’s answer to Coursera, EdX and the like.  It is good to finally see the UK coming to the party with MOOCs in a coherent manner, something that has been sorely lacking over the last 12 months.  I’d signed up a while ago, so I was keen to get stuck in…

The experience was very straightforward; nicely presented content, mostly video, some text, completely inoffensive in usability terms.  Discussion points were occasionally raised but more often than not the comment stream alongside a video was left up to the user to interpret.  There’s no voting system on the comments, so it’s easy to imagine that the sheer weight of commentary will become difficult to sift through quickly.

After I marked each piece of content as ‘complete’ I was invited to try the end of week quiz.  A few Multiple Choice Questions of very dubious quality (did Don Draper make an advert for VW?) and I got 12/15.  I hadn’t actually spent more than a minute on any of the content pages, so the rigour will need to increase as the weeks go by if this is ever to be taken as a vehicle for higher learning.

I’m not sure if anything is going on behind the hood in terms of data or personalization, but it doesn’t look like it so far.  What we have here is a nicely presented set of videos, text and multiple-choice questions.  It is not revolutionary, save for the fact that they are giving it away for free. I’ve searched for a legitimate reason for a University to do this beyond marketing and CSR, but honestly, I can’t find one.  The genius has been in persuading some of the UK’s top institutions that they need to give stuff away for free with no promise of returns.

MOOCs in this form aren’t really MOOCs at all in the traditional sense.  This is very much a bastardised way of interpreting the original theory.  It couldn’t be more linear for the learner if it tried.  I don’t blame them; Connectivist MOOCs (as the theory originators term their own) are an exercise in chaos; connecting folk with a common interest around a core idea and exploring it organically over time.  The FutureLearn way of doing things is the antithesis of this idea, an xMOOC.  It is linear, highly structured into sequential weeks (which you can’t skip ahead on) and very much the same as the last 15 years of online learning.  The discourse is an after-thought.  The educators rely on the content to impart learning to passive students.  FutureLearn looks like it knows this; if it set out to deliver highly usable and highly accessible learning, it has.  If it set out to provide a revolution in online teaching, it has not.

If FutureLearn is not a revolution in pedagogic terms, is it revolutionary in other terms? A key feature of cMOOCs for me is the chance to create a learning experience very quickly, relying on the network as oppose to content to impart learning.  But this course has taken FutureLearn a very long time to deliver – nearly a year.  Whilst it is easy to see that much of that time was probably taken up with politics, the cost of delivering this sort of learning must be unsustainable.  This is a missed opportunity.  The future of learning online is not in the creation of perfect content, but in the curation of learning experiences.  Much of the content is only a minute or so in length; this is right. My own experiences suggest that the shorter the material, the better.  But without a change in the pedagogy, this just leaves us with a series of very short videos. How will the course move beyond the facile?

The UK has made horrific missteps before.  As far as I can tell, the key difference now is timing.  There was a lack of a sustainable business model then, much as there is now.

In teaching terms, I want to see much more being made of the discussion areas.  I want to see peer contributed content alongside Subject Matter Experts.  I want to know that data is being collected throughout to help personalize the experience.  I want the platform to be xAPI compliant and I want Badges.

Commercially I probably want to pay for all this.  I’d much rather create a sustainable, affordable system for the long-term than give it all away because Coursera does. I’m not adverse to companies putting content up in this area. I’d much rather learn programming from Google than any university in the UK.  I also want to really see a shift to more practical, even vocational courses.

Of course, I’ve been quick to judge; I’m sure a huge amount of effort has gone in to getting us this far.  I like the fact that the platform is highly useable.  I like the look of some of the courses coming; MOOCs have a real opportunity to fulfill niches that are hard to reach with other methodologies.  I like the fact that some of the course tutors are outstanding individuals.  We needed this in the UK, but it’s the first step on a very tall ladder. Go judge for yourself.

Shameless self promotion: I’ll be speaking at DevLearn next week on the subject of MOOCs with Professor Simon Croom. Come join in the conversation!

,

1 Comment

The trouble with owning your own learning data

Bundles

In the next couple of weeks we’ll release our beta version of Learning Locker. With this product we’re going to give people an opportunity to take ownership of the data that is created by them when they interact with systems and people. Previously this data has always been locked away in an organisation’s Learning Management System, or is just lost to the ether. That perhaps wasn’t such a big deal when SCORM was the only standard in town; tracking completions and quiz scores wasn’t invading your privacy in a big way.

But two big changes have collided to change all that; xAPI (Tin Can) and the recognition of less formal learning. The amount of data we create about ourselves and our activities is shooting through the roof. Viewed an article? We’ll track that. Made a comment? We’ve got a record. Liked a post? We like that too!

In the age of Snowden and PRISM, this starts to become somewhat alarming. Not having anything to hide is a naïve argument. Taken out of context, data can be used to construe all sorts of arguments and relationships. What’s more, personal data is a very tradable commodity. When Facebook’s value is tied to its marketing revenues, and its marketing revenues are tied to the quality of the data it holds on users, then it’s not really much of a leap to realise that your data is directly equitable to a dollar value. By giving away your personal data you are literally giving away money to other people. If you value the service you get in return then there is no problem. But we shouldn’t kid ourselves into thinking that Facebook and Twitter are free.

Whilst it is important that people start to realise the value of the data they create, it is even more important that people start to take control of their digital footprint. We all need to take steps towards owning our own data instead of entrusting it to other people and for-profit organisations. I’m very far from being the first person to suggest this and various movements exist in propagate this message. But very few of these movements recognise a simple fact; owning your own data is boring. It is dull as ditchwater. Like watching paint dry.

Dave Tosh and I started thinking about the Learning Locker as a way for learners to take ownership of their learning data. This wasn’t so much powered by a fear of big brother, more from the notion that your data is valuable. Sure, you should be able to trust your data to your organization whilst you work for them but they are going to get careless when you leave. Best case scenario it gets deleted. But then, what was all that effort about? As we make increasing amounts of learning data (be it formal or informal in nature), then you should get to own it. This is your permanent record of working life and it is valuable. What’s more, the holy grail of truly personalised work and learning experiences depends on this record being accessible. Systems that you trust should be able to personalise your interactions based on your previous experiences. That’s not possible if the data isn’t yours.

So data ownership isn’t just desirable, it’s a necessary step for the personalisation of learning. That’s why we built Learning Locker. It didn’t take Dave long, a couple of weeks, to pull together a working prototype. And that’s when we realised. Owning your own data is dull. A never-ending stream of mildly interesting anecdotes and out-of-context strings. Sure you can extrapolate some nice stats and quantified-self type info (turns out I read mostly on a Tuesday, who knew?) but even this stuff isn’t interesting beyond the first few minutes. And that’s a real problem, because if owning your data isn’t a compelling and rewarding experience, it’s going to be very hard to persuade people of its necessity.

We’ve spent the last month thinking and iterating on this idea. I’m a big fan of Self-Determination Theory, so I’ve been thinking in terms of Competence, Autonomy and Relatedness. How can we let you use your data to show your improving skill? How can we do this in a framework that is open enough to provide free-choice, but scaffold so that you actually know how to begin. And how can we let you share your data, on your terms, with other people and systems?

This is what Learning Locker has evolved to become. It will be a long journey to make it a part of people’s everyday lives. But we’re really hoping we can take a small step towards making data ownership an intrinsically valuable experience.

No Comments

Learning from social learning

For the last couple of weeks I’ve been facilitating an online LAB, courtesy of the Masie Consortium , investigating social learning. We set out to investigate three key areas:

1. How is the role of social learning evolving in our organisations?
2. How is curation impacting the social learning mix?
3. What effect is gamification having on social?

To facilitate the investigation we decided to eat our own metaphorical dog food and do the whole LAB online as a social learning event. We used Curatr to seed content for discussion into a series of sequential levels. Users would need to contribute in order to earn ‘experience points’ and rise through the levels to the finish.

I was delighted with the level of participation the LAB gave to the event. We had around 50 register to take part; 35 logged on and 20 went on to really contribute meaningfully to the debate. That might at first glance appear like a poor turnout, but the fact is this was more akin to a MOOC than anything else and getting 40% of your audience engaged in a MOOC is pretty much unheard. Over the course of two weeks, working in their spare time, our LAB contributed over 25,000 words to the debate and doubled the amount of content we had curated initially.

Did we learn anything?

I hate it when you get asked immediately at the end of a session ‘what have you learned?’ For me, the learning from an experience is only proven after the event, when the connections you made start to stick and change the way you think and behave. It’s now been about a week and a half since the end of the LAB and I think I’m ready to commit a few key insights to paper.

First, I’ve been really adamant in the past about my stance on social and learning; that all learning is inherently social. We had some philosophical debates about the people reading books on deserted islands. I still think I’m right; others think I’m being pedantic. I think maybe they are right too. But perhaps I get too easily drawn into big philosophy debates about the nature of learning. Does anybody care about this stuff? Or do we just want results? I think maybe it’s the latter, despite my readiness to talk about the former.

Second, the group’s contributions on gamification mentioned the need for personal meaning time and again. For instance, one participant wrote, “my kids and I are members of the Kahn Academy, and we compete to get moon and earth badges, and what not. Do I care about the type of badge I’m getting? Not a bit! But it is socially meaningful for us to share this experience together.” I think that’s something significant; that participants in a gamified experience need to be able to select for themselves what they choose to pursue. Simply telling people that points or badges are important doesn’t make it so. Especially when they have no inherent value.

Third and finally, I got really reinforced around the concept of curating content as the basis of a learning experience. It took me less than a day to gather content from around the web to seed our conversations. Participants reported spending up to 4 or 5 hours each browsing, reading, commenting and curating around these insights. This flips the notion of eLearning design on its head; where hundreds of hours of design yield a few minutes of instructional experience. My message is simple; stop trying to make the perfect piece of content. You never will. Allow your learners to select the most relevant resources for themselves.

As a side note to this last piece, all but one of the pieces of content I gathered was social in some way – a user-generated video or a blog for example. These were all bite-sized pieces of less than 10 minutes content, most were less than 5. Just once I snuck in a PDF article taken from a book. It was about 10 pages long. Nearly everyone hated it. Not because the content was inherently bad; some participants found meaning in the message. It’s just they hated having to scroll down page after page of text.

These Gen X folks…no attention spans, I tell you…

, ,

6 Comments

Learning Locker: it’s your data

Guest blogger: Dave Tosh

A new product that we are currently working on here at HT2, Learning Locker, has several important aspects at its core, one of which is data ownership.

In a nutshell, Learning Locker provides a destination where users can create a personal locker housing their learning data that they can then put to work for them. The data comes from a variety of sources including the web and any learning platform that exports Tin Can statements.

From the official Tin Can site:

“The Tin Can API (sometimes known as the Experience API) is a brand new specification for learning technology that makes it possible to collect data about the wide range of experiences a person has (online and offline).”

How does it work?
The initial prototype is fairly basic. Users create an account and add any email addresses which they wish to be associated with their learning locker account, similar to a Gravatar account. You might have a personal email address, a work email address and an email address you were given for night classes at a local college. Adding these addresses ensures that any TinCan statement sent containing one of your email addresses will end up in your personal locker.

One statement might relate to something read and shared from Gigom on a personal level:

"actor": {
"name": "Dave Tosh",
"mbox": "mailto:myemail@gmail.com",
"objectType": "Agent"
}
"verb": {
"id": "http://adlnet.gov/expapi/verbs/shared",
"display": {
"en-US": "shared",
"en-GB": "shared"
}
},
"object": {
"objectType": "Activity",
"id": "http://gigaom.com/2013/04/30/coursera-makes-first-foray-into-k-12-education-with-online-courses-for-teachers/",
"definition": {
"name": {
"en-US": "Coursera makes first foray into K-12 education with online courses for teachers",
"en-GB": "Coursera makes first foray into K-12 education with online courses for teachers"
}
},
...

Another statement could come from work training:

"actor": {
"name": "David Tosh",
"mbox": "mailto:dave.tosh@ht2.co.uk",
"objectType": "Agent"
}
"verb": {
"id": "http://adlnet.gov/expapi/verbs/experienced",
"display": {
"en-US": "experienced",
"en-GB": "experienced"
}
},
"object": {
"objectType": "Activity",
"id": "http://curatr3.com/museum/view/demo/0#!object/57",
"definition": {
"name": {
"en-US": "The Tyranny of the Next Button",
"en-GB": "The Tyranny of the Next Button"
},
"description": {
"en-GB": "Perhaps we don't need to go through the course development process in the same way. Even exceptional instructional designers struggle under the weight of information that we are often asked to convey in a normal piece of Courseware.",
"en-GB": "Perhaps we don't need to go through the course development process in the same way. Even exceptional instructional designers struggle under the weight of information that we are often asked to convey in a normal piece of Courseware."
},
"extensions": {
"http://curatr3.com/define/extension/bookmarkType": {
"bt_id": "1",
"bt_text": "Added to my knowledge"
}
}
}
},
...

How do I get my data into my personal locker?
There are a few ways to import and save your data.The first is via our bookmarklet, this makes it easy to capture experiences that occur while you are accessing resources on the web. We are also working on a ‘Learn this’ button which will work in a similar fashion to the Facebook ‘Like’ button but with extra metadata built in such as ‘This challenged my thinking’, ‘This helped me understand X’ and so on (you can see an example above under the object extension). The final method is via learning platforms you use in school, at college, at work or online. If they support Tin Can, then, you should be able to get your learning statements out and into your locker. To help support this we are working on plugins for some of the major players such as Moodle.

Export
As you would expect, with a Learning Locker account, all your data is yours and can be exported at any time. Further to this, we are developing an open source version that individuals can host if they prefer.

Approach
While a Tin Can statement appears basic at first glance, they can become complex quickly. To handle this, we are using a combination of tech. For our initial service, we parse incoming statements and abstract a couple of key components; actor, verb, object, and where available, context. This high level data allows us to offer the first phase of the learning locker, which is the storage and filtering of learning statements based on the action, source, time and reason.
To provide deeper analysis we store the full JSON object in a NoSQL database, so, over time, we can drill into the data exposing insights that we hope will lead to useful services for learners; helping predict learning paths, highlight areas of strength, topics needing addressed and so on.

What’s next?
We are currently testing an early prototype and will shortly solicit volunteers interested in providing feedback on the service. Stay tuned.

Dave Tosh is passionate about technology, in particular the web, and its potential for creating new learning opportunities for us all. Dave is a pioneer in the social learning space, co-founding Elgg. He is now working with HT2 as the product lead on a new learning service, Learning Locker and continues to experiment on a new goals based learning platform. Follow him on Twitter @davetosh.

, ,

No Comments

The Realities of MOOCs

Curatr MOOC
This blog first appeared on the ASTD’s Learning Technologies blog, March 2013.

Two weeks ago we launched a Massive Open Online Course (MOOC) in association with the University of San Diego (USD). Based on “Sustainability in the Supply Chain,” the six-week course is aimed at managers working in supply chain positions around the world. For those unfamiliar with the MOOC terminology, this sort of course operates at scale and is open to anyone who wishes to join.

Two Types of MOOCs

Broadly speaking there are two types of MOOCs: cMOOCs and xMOOCs. cMOOCs follow a “connectivism” approach, which is based on the work of George Siemens, Stephen Downes, and others working at the forefront of online learning theory. (Siemens and Downes host http://mooc.ca as a place to host MOOC news and information.)

cMOOCs are something of an experiment in chaos; their mantra is to gather a wide range of people together to discuss and discover a subject that interests them and enables them learn in anyway they see fit. This style of course is open—not because of cost (or lack thereof), but because of the manner in which participants learn.

cMOOCs encourage the use of any platform, any content, and any connection a learner wishes to make. Also, the fact that cMOOCs are massive is important because it creates opportunities for learners to make connections with a diverse range of people. Exactly how massive a course has to be to be considered “massive” is something of a contentious point, but Downes suggests Dunbar’s number of 150 as the cut-off point.

However, cMOOCs are generally not the ones being written about in the New York Times. Instead, folks seem more interested in the MOOCs with hundreds of thousands of participants; those are the xMOOCs.

xMOOCs are those most commonly found on platforms like Coursera, Udacity, and EdX. You know instantly there is a difference because the xMOOC has a platform—the cMOOC methodology tells you to go make your own platform. xMOOCs stick closer to well-known methods of online learning, such as video tutorials and quizzes. There is variation in the form of peer marking and social discussion opportunity, but these aren’t required features.

A Closer Look at Our MOOC

Our MOOC is—in the strictest sense—an xMOOC. We have curated the content, put it into a course framework, and set our students free to roam through it. However, elements of a cMOOC are creeping in. We give a wide range of autonomy to students to browse what they want, and students can add learning content back to the platform right alongside our original learning materials. We encourage participation constantly and use peer review. Organized chaos, if you will.

The biggest job that companies like Coursera perform for those delivering MOOCs is marketing. Getting 100,000 students to sign up for a course outside of these marketplaces is tough. That is why we were delighted when more than 650 students signed up for our MOOC—a testament to social media and good old fashioned marketing organized by the Supply Chain Management Institute at USD.

In the interest of science, we decided to run a few experiments to check out the effect of class sizes and previous exposure to higher education. First off, we wanted to know if engagement varied with class size. So we broke our students into three key groups; one of 300, one of 150, and one of 50. Everything you’ve ever read about education tells you that big class sizes are bad, personalized learning experiences are good. MOOCs claim to run counter to that—by exposing learners to more people, they get to choose those people that they wish to participate alongside.

What We Are Learning About MOOC Learners

We’re only two weeks in, but we’ve got a fair amount of data already. The first thing we noticed is the dropout rate; only 50% to 55% of students registered for the MOOC signed in to the course. This data corresponds with what others have reported elsewhere, so it isn’t surprising. With no skin in the game, many don’t start the course.

From our large group (300 enrolled) 60 learners made it to level three of the module, which is about the halfway mark. In the next group (150 enrolled), 28 made it to the same point. And in our small group (50 enrolled) just 4 made it to halfway.

If we remove those who never logged on in the first place, around 40% made it to halfway in the big group, 39% in the medium group, and 13% in the smaller group. If engagement is any measure to go by, then small class sizes don’t make for a great experience in the world of MOOCs.

Those of you keeping tally will notice that I’ve missed 150 people out of this assessment. This is a deliberate mistake!

We saved another piece of research for three final groups of about 50, whom we sorted based on the amount of higher education they had previously completed. The first group had Master’s-level qualifications or higher, the second group had Bachelor’s degrees, and the third group had high school or Associate’s degrees.

Again those actually logging on was in the 50% region. In the Master’s group, 16 reached the halfway point or beyond; the Bachelor’s group had 9 reach halfway, and in the high school group only 4 made it halfway through the course. Those numbers equate to 60 percent, 33 percent and 17 percent, respectively (of those who logged on at all). When compared with the random selection of 50 students, the Master’s students showed themselves to be much more readily engaged by the learning process—four times more so.

On the face of it, it would seem that those who have already been exposed to an advanced education learn best with MOOCs. The course itself is accredited at the Master’s level, but I don’t suppose this is particularly unusual for a MOOC—as they tend to be aimed at niche areas in advanced subjects, given by the likes of MIT, Stanford, and so forth.

Does this mean MOOCs can’t be used for a wider section of the population? Absolutely not; after all, people still complete the course regardless of their background. But it seems to come most easily to those who have explored learning at its highest and potentially most self-directed level.

Looking Ahead

It’s been said before, but the biggest challenge ahead for the MOOC Revolution is perhaps to be had in learning how to learn. Maybe then the field will open up to cMOOCs taking center stage in the future of online learning.

And we are still in the early days for our research of our MOOC, so I won’t jump to conclusions—just yet. More important, I’ll have more data when I present the final output at the ASTD conference in Dallas, so please do come by my session on Wednesday morning to find out more and continue the debate.

3 Comments

Resources and references from my #lt13uk workshop – game-based learning

Thanks to @KimSGeorge for the image

Thanks to @KimSGeorge for the image

On day two of the Learning Technologies conference I ran a session on game-based learning, with a specific focus on application in the workplace, impact and cost. I was (and still am) of the opinion that it is something of a fringe subject for the Learning Tech world, but the size of the audience suggests otherwise. It looks like game-based learning and gamification are perhaps on the verge of a tipping point in to the mainstream…

Anyhow, throughout the talk (and one I did previously, Playing Games with Quality, in the exhibition hall), I littered the place with references, many of which might have got beyond the eager tweeting. So here’s a list of things I referenced. If I miss any, let me know…

Research on the efficacy of game-based learning:
Sara de Freitas – Learning in Immersive Worlds report
Simon Egenfeldt-Neilson – Overview of game-based learning research
Traci Sitzmann – Analysis of the research in to effective instruction using games. or see: PixelLearning
Tom Malone – Toward a theory of intrinsically motivating instruction (1981)
Sara de Freitas – Literature Review of gaming practices for learning
Sara de Freitas & Martin Oliver – evaluating exploratory learning in games

Research on wider theories:
Deci & Ryan – Self-Determination Theory wiki plus academic papers
Benjamin Bloom – The Two-Sigma Problem
Garrison et al – Cognitive Presence
Dan Pink – Drive
Thaler & Sunstein – Nudge
James Paul Gee – Affinity Spaces
Marc LeBlanc – Eight types of fun

Game Design and Gamification books:
Jesse Schell – The Art of Game Design: A book of lenses
Karl Kapp – The Gamification of Learning and Instruction
Raph Koster – A theory of fun for game design
Jane McGonigal – Reality is Broken
Bernard Suits – The Grasshopper: Games, life and utopia

Games:
America’s Army
Manga High
PonyPrep
Portal 2 – Teach with Portals
Minecraft
Campden Springs – ARG
Curatr – gamified learning platform
Zombie’s Run
Nike+
Stack Overflow – Gamified Q&A

, ,

2 Comments

House, MOOC’s and corporate training

Henry Dobson was one of the few people with whom Greg House ever wanted to form a friendship. It could never have worked out. They were too similar. You see, Dobson’s knowledge of medicine was exemplary, almost as good as House. But if House had wanted someone to agree with his opinion, he’d have looked in the mirror. What Dr. House needed when it came to solving complex problems was diversity. He needed people who would stand up to him; disagree with him. Dobson wasn’t that man. As Dobson put it, you don’t need someone to tell you what you already know.

Which leads me to the obvious question, why should a MOOC be massive? Whilst MOOC’s have grown exponentially, the theory of knowledge underpinning them, Connectivism, has grown more steadily. Somewhere in the hysteria the point kinda got lost. MOOC’s are massive because they operate under the assumption of a network effect; they are decentralized and devolved to provoke connections. What MOOC’s seek is a diversity of opinion. It goes without saying that the quality of the experience is driven by the quality of the dialogue and debate. If this debate is within a small group, or driven by a teacher, or with a bunch of Dobson’s, then the outcome will always be the same. Consensus. Boring, mundane consensus.

I’m afraid that organisations are eyeing up the MOOC trend a bit too readily. On the face of it, it seems like a great excuse to make some content and then make thousands of people watch it. But of course, this misses the point entirely. Content is a trigger for connections at best. It should spur the creation of new content, new ideas, connections. The outcome of all this is unpredictable. Which makes it very much the antithesis of the training and development department.

This is why I’m starting to think that any corporate application of MOOC theory would do well to steer well clear of the training department. Instead it should focus on solving problems. Forget training. Training brings standardisation.

I’m interested in bringing MOOC theory to process redesign. The ability to connect a diverse group of participants around a single topic, to get them to connect with each other and create content, ideas and debate really intrigues me. I believe that it’s only through diverse connections that innovation occurs. Which is why House needs a team that is nothing like him. Anything less would be lethal.

2 Comments

50 free sources of learning content for your curation

Christmas always brings a conundrum. The kids want new toys, but they don’t play with the ones they’ve already got! Dutifully, you spend your hard earned cash adding to the pile of toys. Recognition is fleeting. By the time you read this blog, all new toys will have become a part of the amorphous mass of toys that sits in the corner of the bedroom. There they are doomed to remain, relatively untouched for the rest of the year, until of course the cycle begins again.

Nothing changes as we get older. Or indeed when we move to the world of work. New toys, that’s what we need. Or do we? Maybe, if we make just one resolution this year, it should be to play with the toys we’ve already got. It’s with that thinly stretched metaphor in mind that I give you this:

50 free sources of learning content for your curation.

I think it’s a bit of a travesty that we spend as much as we do trying to make the perfect piece of learning content, again and again. Of course the learning process takes us far beyond the realms of what content alone can do; we need learners to experience, practice, reflect and repeat real-world actions if they are to truly change behaviour. Content can be the start; it can be the trigger for a new experience, a new insight, a new conversation. But it is just that, the start of a learning journey. So I believe we should spend more time tapping into content that is freely available and putting this to use within our organisations. Our time, money and effort should be spent elsewhere – on the experiences and implementations that allow learners to put ideas in to practice.

With that in mind we’ve quickly curated some sources of information for you to tap. These websites host huge amounts of content on a wide-range of subjects, but in the interests of keeping the numbers down the following sites are of particular use to those looking to trigger learning experiences in the business world.

Name URL Description Good for
OER Commons http://www.oercommons.org/browse/general_subject/business Links to over 1000 business related learning content objects Academic articles
Stanford Business School http://www.youtube.com/user/stanfordbusiness Stanford Business School videos Videos
Management for the rest of us http://www.mftrou.com/ Introduction to management topics Introductions
Jim Collins http://www.jimcollins.com/media_topics/all.html Video and Audio resources from leading business author, Jim Collins Management, leadership
Team technology http://www.teamtechnology.co.uk/ Introduction to issues around leadership and management Psychometrics
Free Management Library http://managementhelp.org/ Huge range of management topics Management, leadership
CIO http://www.cio.com/ White papers, webcasts everything for the Chief Information officer CIO
Leaders Direct http://www.leadersdirect.com/ Over 150 pages of tips and checklists on leadership and self management Leadership
PowerHomeBiz http://www.powerhomebiz.com/ Site for small businesses with good tips and glossary Small Business
Fast Company www.fastcompany.com The website for Fast Company magazine contains an easily accessible searchable archive of all its articles, past and present. It contains a number of interesting articles concerning power and office politics.  Good for leadership, strategy, teamwork innovation, web
Harvard Working Knowledge http://hbswk.hbs.edu/ Great papers across the range of management topics from some of the key experts in the field Management, leadership
Frances Hesselbein Leadership Institute http://www.hesselbeininstitute.org/ Formerly Peter Drucker site, links to Leader to leader journal Management, leadership
Wharton Leadership Centre http://leadership.wharton.upenn.edu/welcome/index.shtml Leadership research papers, access to older articles leadership
The Business Publications Search Engine http://www.bpubs.com/Management_Science/ Good links to articles on BPR, Change, CRM, Leadership Project management and many others Management papers
Customer Care Institution http://www.customercare.com/ Everything about looking after the customer Customers
PM World Today http://www.pmworldtoday.net/archives/2012/march.htm#papers Featured papers on the subject of Project management Project Management
Project Management Institute http://www.pmi.org/Knowledge-Center.aspx Knowledge centre – resources to inform and improve the practice of project management Project management
Thinking Managers http://www.thinkingmanagers.com/ Edward de Bono and Robert Heller site giving clear and concise summaries of the best writing and ideas from the world’s best business media Management
The Work911 series http://work911.com/articles/index.htm 200 articles covering a range of management topics Management
12 manage http://www.12manage.com/ Summaries of management methods and models Models
Alliance Training and Consulting http://www.alliancetac.com/index.html?PAGE_ID=34 Good range of resources covering communication skills, customer service, employee development, leadership and many others management topics
MagPortal.com http://www.magportal.com/c/bus/strat/ Portal site that gives links to latest magazine articles on business strategy,management and leadership Magazine portal
Bloomberg Businessweek http://www.businessweek.com/ The latest uptodate thinking, articles, videos Latest thinking
Inc.com http://www.inc.com/ Latest thinking on leadership and managing, sales and marketing, Finance, Technology and Innovation Latest thinking
Curious Cat Management Improvement Connections http://curiouscat.net/articles/ Articles focused on operations management and improvement Operations management
Article Planet.net http://www.articleplanet.net/management/ Shortish articles covering an eclectic range of management topics Management
OER Commons http://www.oercommons.org/browse/general_subject/business Great source of open resources, mainly focused on schools but a good range of material on business for the post-secondary level Open resources
MIT OpenCourseWare http://ocw.mit.edu/index.htm Incredible resource of lecture notes and videos MIT Courses
MIT YouTube http://www.youtube.com/user/MIT Videos of lectures – not all areas covered but those that are are covered in great depth MIT lectures
TED Talks YouTube http://www.youtube.com/user/TEDtalksDirector Great range of videos from inspirational speakers Videos
Harvard YouTube http://www.youtube.com/user/harvardbusiness?ob=4&feature=results_main Great range of videos from some of the world’s experts Videos
The Ken Blanchard http://www.youtube.com/user/KenBlanchardCos?ob=0&feature=results_main Leadership videos Management videos
Wikiversity http://en.wikiversity.org/wiki/Wikiversity:Main_Page Growing site with some business and management courses Wiki resource
Learn out loud http://www.learnoutloud.com/Podcast-Directory/Business/Leadership-and-Management Portal to a range of management podcasts Podcasts
Emerald Research http://www.emeraldinsight.com/learning/podcasts/index.htm Podcasts drawn from the latest research published by Emerald Academic, podcasts
Under New Management http://www.obweb.org/index.php?option=com_content&view=category&id=42&Itemid=66 Podcasts focusing on rigourous empirical research Academic, podcasts
Bized http://www.bized.co.uk/learn/index.htm Whole range of different sorts of materials such as worksheets, case studies Business studies materials
CBS Money Watch http://www.cbsnews.com/moneywatch/management/?tag=hdr;cnav Main focus on financial issues but other management issues covered Finance
Business Balls http://www.businessballs.com/ Businessballs is a free ethical learning and development resource for people and organizations, run by Alan Chapman, in Leicester, England Business studies materials
Khan Academy – Finance & Economics http://www.khanacademy.org/#microeconomics College level Economics done in Khan Academy house style – a voiceover with drawings Finance
Business Link Start-up Directory https://online.businesslink.gov.uk/hub/action/render?pageId=learningdirectory Everything you need to know about getting started in business – but also useful for those working within organisations Business Startup
Marshall Goldsmith Library http://www.marshallgoldsmithlibrary.com/html/marshall/resources.html Personal site of Marshall Goldsmith, the influential leadership thinker Leadership
5min Business http://www.5min.com/Category/Business Video aggregation website, taking in content from a range of business websites Videos
Tom Peters! http://www.tompeters.com/freestuff/index.php A selection of Tom Peter’s content available freely, as long as you do not charge for their use Management, leadership
Business Insider Document Centre http://www.businessinsider.com/document-center A selection of simple (US) templates for business and legal documents Business Startup
Business Model Generation http://www.businessmodelgeneration.com/canvas A great method for creating business models Business Startup
The Times 100 – Business Studies Theory http://businesscasestudies.co.uk/business-theory/ Topic overviews with pay-for case studies available Business studies materials
FastCoExist http://www.fastcoexist.com/ From The Fast Company, a website focused on breakthrough innovation innovation, web
Systems Thinking – John Seddon http://www.systemsthinking.co.uk/6.asp A wide range of articles on Systems Thinking and Lean Operations management
Clayton Christensen http://www.claytonchristensen.com/key-concepts/ Summary and links to articles by Clayton Christensen, Harvard Professor Management, leadership
Ted ED http://ed.ted.com/lessons?category_id=41 TED videos with a focus on business and economics and quiz questions. Business and Economics

If you’d like to learn more about the role curation can play in your learning strategy, why not come along to CurationCamp, on the Tuesday evening following London’s Learning Technology 2013 conference. It’s free and beer will be supplied (for a bit!) by yours truly and Curatr. If you can’t make it you can follow the event on twitter with the hashtag #ltuk13fringe

, ,

1 Comment