Saturday 4 February 2012

Quality Assurance in Courseware Design and Development using OERs

Open Educational Resources (OERs) are gaining momentum in education and throughout diverse academic communities. However, the quality element is still a concern for many. This article discusses the quality element with respect to the courseware design, development and delivery when OERs are used. The issue of quality needs to be addressed in the broader quality assurance framework for courseware development.

The issue of quality assurance (QA) has increasingly become a priority for Higher Education institutions. As universities compete to attract more students, but also to attract financing through various projects, quality represents one of the main criteria for ensuring a significant share of the educational market (Abdous 2009, p. 281). Guaranteeing quality, however, is not always an easy process, first and foremost because the very concept of "quality" is disputed and many different, contextual definitions are used (Mihai 2009).

The main barrier to such an innovative way of using OERs to reconceptualise the educational process in traditional universities are the quality assurance procedures that need to be 'strictly' followed. In a traditional lecture, quality is believed to be maintained if the lecturer spends 3 hours in the classroom irrespective of what he does or not. This is proved by the log book in which he signs. In another context, quality is maintained if students' results follow the normal distribution and if academic/administrative records related to the course are duly kept. Furthermore, quality is considered maintained if feedback forms are given, at the end of the semester, to students who fill in most of the time in a subjective way. This perspective of viewing quality poses a problem for bringing innovation and creativity in the learning process. Quality is a non-referential concept and quality assurance techniques that are applicable in behaviorist learning environments are not compatible in socio-constructivist ones. The quality framework that can be applied depends on the learning design approach to be adopted. Quality assurance needs to be an ongoing and iterative activity and student feedback on their own learning (problems encountered, things that were easily understood, communication problems and other related issues) contribute towards making them better learners and develop the required competencies.

This paper looks at the issue of quality assurance when OERs are used for courseware development purposes. It is clear that the main issue surrounding OERs use relates to the phase when the content is being developed while the other phases will normally fall into the existing quality assurance mechanisms of institutions. However, this perspective of viewing quality depends on the granularity of the OER being used.

Open Educational Resources provide instructors with an innovative way to conceptualise courses. The philosophy behind it is that courseware development becomes a distributed and a split 3-phased approach. This means that the development of content can be done by anyone, anywhere and at any point in time, thus becoming the first phase of the process. The instructor involved in the use of OERs has practically no control over this phase but has access to a range of tools than can give him access to content having been developed in that phase. A simple example would be to use a search engine to look for related content or to access OER repositories. The other phase would be to build-up the course from the content available manually or through the help of courseware building tools. The third phase would be the delivery and dissemination of the course content in a face-to-face classroom or via an e-learning platform. The instructor might have control on both phase 2 and 3 or on only one of them. This approach being an innovative way in itself, is set however to be a “disruptive process” in well established traditional educational systems especially with respect to the quality issue.

Issues of quality in educational processes normally arise in terms of
  • The content – its selection, aggregation and presentation
  • The pedagogical approach used
  • The delivery of the course
  • Students’ satisfaction, performance and acquired competencies

The most obvious issue of quality in OER-based courseware development process relates only to the content development phase on which the author has no particular control. This is where most of the concerns related to quality assurance lies. Traditionally speaking, reliable sources of academic information were only books, and published research (journal articles and conference papers) as well as from the academic’s philosophical perception of things (academic freedom). With the democratisation of access to content and the removal of publishing constraints via the web, reliability of information presented in content has been of great concerns to educational authorities. In this context we wish to highlight a very simple fact that out of ten consecutive searches that were tried on different topics on Wikipedia returned a number of resources which warned on the top about the reliability of the content (information) being presented to the user. Furthermore, most searches done on Google for particular information would most likely return Wikipedia as one of the top 5 sources.

The fact that OERs came into the limelight more or less with the emergence of Web 2.0 era (contrary to the Learning Objects Concept) contributed to the significance of the concerns regarding QA issues. Therefore academics and instructors using OERs need to have a well-established set of guidelines that would provide a framework for the search and use of freely available content from the Web. De-facto trusted sites like the OpenLearn platform, Connexions and Curriki, just to name a few would greatly help but it is in fact very difficult for an institution to control such activities of their staff. One possibility would be for OERs to form an integral part of the institution’s courseware development policies rather than being used on piece-meal basis by individual academics.

It is important to note that peer-reviewing has over the years proved useful in research-related quality assurance systems. With the concept of collaborative editing through wiki technologies, the concept of peer-reviewing has been very much the motor for those promoting an approach based of OER development through communities of practice. However, the issue that remains contradictive is the impersonation issue. While there are ways to counter this, sites like Wikipedia and others will definitely encounter difficulties to enforce identity checks for its users. One recent article on the web also mentioned the declining number of people who were involved in ‘watching’ of pages and their content on Wikipedia.

One possibility to counter the above problem is therefore to completely rethink (re-engineer) the pedagogical approaches used when designing courses using OERs. When courses are fully content-oriented, it is obvious that quality assurance processes will focus mainly on the content being used and presented to the users. However, if the content is not the central focus, but an element in a broader pedagogical scenario, then the whole quality assurance issue takes a different perspective. The concept of project/activity-based learning that focus on the development of a set of skills and competencies by the student through socio-constructivist models can be useful. Quality assurance will in this case be a process that ensures the learning path of the learner will lead to the desired outcomes. In doing so, using a variety of available contents on the web which are labelled as OER is not a problem as the learners will develop higher order cognitive skills where they can synthesize, argue and discuss on the contents rather than adopting them to be factual information. However, again as was mentioned earlier, this different perspective can be disruptive to the traditional organisational processes of QA.

1 comment:

  1. Indeed, Quality assurance is more practical as we deal with concrete ‘products’. About policies to be developed, it may be a good idea but still, the QA should be a specialized one in the development phase as it is very limited to develop common standards for courseware design and development .

    ReplyDelete

Please abide by the netiquette of online commenting. Please be respectful and contribute to the debate through constructive criticism and intellectual arguments.

The polemic surrounding University Ranking of UniRank (4icu.org) : The case of UoM being 85th in the African Top 100

This is an interview I gave to the News on Sunday paper that appeared on 26th July 2020. 1. There is a controversy about the ranking of ...