Monday, November 17, 2008
1:30 PM-5:00 PM
Abstract:
To conduct a comprehensive evaluation of e-learning requires a "triangulation" approach whereby multiple models and procedures are applied. Conducting comprehensive evaluations of e-learning in a timely and efficient manner is the focus of this tutorial. Why is evaluation of interactive learning so important? Around the world, each month sees the introduction of many commercially produced or locally developed programs promoted as effective e-learning systems. Yet systematic evaluation of the implementation and efficacy of these systems is often lacking. This tutorial is specifically designed to establish evaluation as a key strategy throughout the design, development, and implementation of e-learning at all levels of education and training. Participants will be given access to an electronic performance support system (EPSS) designed to help educators evaluate e-learning.
Objectives:
Participants in this tutorial will learn how to implement models and procedures for evaluating e-learning at all levels of education and training. Tutorial participants will learn to develop, implement, and report specific plans, strategies, and tools for six major phases of the evaluation of e-learning:
1. review,
2. needs assessment,
3. formative evaluation,
4. effectiveness evaluation,
5. impact evaluation, and
6. maintenance evaluation.
Outline:
The following topics will be presented in this tutorial:
• Establishing a Rationale for Evaluating E-Learning
• Six Facets of Evaluation for E- Learning
• How to Prepare a Plan for Evaluating E-Learning
• Specific Strategies for Evaluating E-Learning
• Tools for Evaluating E-Learning
The tutorial includes presentations with actual case studies that are focused on a variety of e-learning evaluation strategies. After attending this tutorial, the participants will be able to perform the following tasks:
1. Describe different paradigms for evaluation in education and training.
2. Distinguish between:
a. assessment and evaluation;
b. internal and external evaluation;
c. intrinsic and extrinsic evaluation; and
d. formative and summative evaluation.
3. Implement six facets of evaluation for e-learning:
a. review;
b. needs assessment;
c. formative evaluation;
d. effectiveness evaluation;
e. impact evaluation; and
f. maintenance evaluation.
4. Outline an evaluation plan for various forms of e-learning.
5. Recognize the advantages and limitations of e-learning evaluation.
Prerequisites:
Designers, developers, and users of e-learning systems including computer-based training, distance education, interactive multimedia, and web-based learning environments.
Intended Experience Level:
Beginner
Instructor Qualifications:
Dr. Thomas C. Reeves is a professor of Learning, Design, and Technology at The University of Georgia where he teaches program evaluation, multimedia design, and research courses. Since receiving his Ph.D. at Syracuse University, he has developed and evaluated numerous interactive multimedia programs for both education and training. In addition to numerous presentations and workshops in the USA, he has been an invited speaker in other countries including Australia, Belgium, Brazil, Bulgaria, Canada, China, England, Finland, Italy, Malaysia, the Netherlands, New Zealand, Peru, Portugal, Russia, Singapore, South Africa, South Korea, Spain, Sweden, Switzerland, Taiwan, and Tunisia. In 1995, he was selected as one of the “Top 100” people in multimedia by Multimedia Producer magazine, and from 1997 - 2000, he was the editor of the Journal of Interactive Learning Research. In 2003, he was the first person to receive the AACE Fellowship Award from the Association for the Advancement of Computing in Education. His Interactive Learning Systems Evaluation book (co-authored with John Hedberg) was also published in 2003.
Reeves, T. C., & Hedberg, J. G. (2003). Interactive learning systems evaluation. Englewood Cliffs, NJ: Educational Technology Publications.