Evaluating
Curriculum Effectiveness
Text outline to accompany PowerPointÒ Presentation
CDR John R. Holman , MC, USN
(edited for web page by CDR DL Hufford, MC, USN, 03 JUL 99)
Faculty Development Fellowship
Madigan Army Medical Center
Objectives:
- Understand the differences and similarities between evaluation of curriculum and evaluation of learners.
- Review the systematic approach to evaluation.
- Discuss the pros and cons of various evaluation instruments.
Introduction:
When evaluating the effectiveness of a curriculum, assessing the performance of the learners is but a part of the whole. There is a step-wise approach to evaluation that can assist us in performing effective evaluations that can improve our curriculums. Some performance evaluation tools are included in the handout.
Stepwise approach:
- Identify the decision
makers
This will vary from institution. Are the decision-makers those in administrative positions in the department or hospital that affect the rotations? Are they those who provide funds through a residency grant? Are they the residents and/or medical students? It is important to identify these people before establishing the evaluation program.
- Specify purpose and
objectives
The educational intents must be written down if there is to be an adequate evaluation. These objectives may state the behaviors we desire our residents or students to acquire. Other purposes may be directed toward changes in institutions or towards revenue generation. Educational programs can have multiple purposes; each purpose warrants evaluation.
- Select indicators of
success
Clarify the performance criteria you will use to indicate success. Are these personal or standard criteria? Do they cover parameters such as program soundness (i.e. educationally well-designed), learner satisfaction, acquisition of knowledge or skills, and philosophical and actual commitment to change (i.e. use of new knowledge and skills in patient care).
- Develop data gathering
materials
Determine approaches to be sued to document evidence that the defined purposes/objectives are being successfully attained. With something like participant satisfaction, an opinionnaire might be used; for resident knowledge, achievement tests; for philosophical commitment, a personal interview would be appropriate. Does the method provide you with inferential or direct information?
- Collect data
Determine your collection procedures – from whom do you collect data? How often? Remember to train evaluators regarding your criteria for success.
- Analyze data
- Distribute results
- Solicit feedback
- Make revisions
|
|
|
|
|
|
|
|
