Evaluating
language
material
Dr.
Khalid
AlGhamdi
[email protected]
@dr_kalghamdi
In this presentation
• McDonough & Shaw Evaluation framework
• Q&A
McDonough & Shaw Evaluation framework
• Three levels evaluation framework, that focus on :
1. External evaluation
2. Internal evaluation
3. Overall evaluation
1. External evaluation
• What is it?
• A brief overview of the materials from the outside, namely the cover,
introduction and table of contents.
• How is external evaluation conducted ?
• Through the Cover & Introduction:
1) About the author
2)Intended audience
3)Educational context and proficiency level
Presentation of language items
• Through the Table of Content:
1) Is there a vocabulary list/ index?
2) Is there any assessment within the teaching materials?
3) How is the presentation layout?
4) Is the content culturally biased?
5) Are there visual materials to supplement & enhance learning?
External evaluation
• Other considerations:
1) How are the materials to be used, core or supplementary?
2) Durability of the materials
3) Availability of teacher’s book
4) Effectiveness vs Cost
Internal evaluation
Key aim:
Is to examine the extent to which the external evaluation factors
match up with the claims made by the publisher of the material
actually presented in the course book. This is done through
examining at least 2 units of the course book materials to
investigate:
(1)Skills presentation in the materials:
• Are the language skills to be covered in the curriculum sufficient
for the learner?
• Are the skills to be taught discretely or are they integrated into
the lessons?
Internal evaluation
2) Grading and sequencing of material:
• Are the material presented/graded from easy to difficult?
• Are the materials arranged in modules?
• Do the materials have to be covered in a specific order?
3)Reading/discourse skills
• Is there sufficient practice for learners in reading/discourse
skill development?
4) Listening material and recorded materials:
• Is speech authentic and does it contain features of
spontaneous speech?
5) Speaking materials and portrayal of real interactions
• Are the interactions familiar, interesting and learner-appropriate?
6) Relationship of tests and exercises
• Do they cover learner and syllabus needs?
• Do they cover what is in the course material?
7) Opportunities for different learning styles, including self-study
• Is there opportunity for independent learning?
• Is there opportunity for learner autonomy?
• 8)Motivation to use the course book by both the teacher and learner
• Are materials learner-appropriate and easy to use for the teacher?
• Are there guides to frame interactions between the teacher and learner?
• Is there flexibility in the use of the course materials?
Overall evaluation
The overall evaluation:
4 factors to be considered when making an overall evaluation:
• The Usability Factor:
• How far the materials could be integrated into a particular syllabus as
“core” or supplementary?
• Selecting materials that meet our EL syllabus or objectives
• The Generalizability Factor:
• Is there a restricted use of “core” features that make the materials
more generally useful?
• While some parts of the material may not be useful, some parts
might be
Overall evaluation
• The Adaptability Factor
• Can parts be added/extracted/used in another context/modified for local
circumstances?
• Some parts may need modification and when it is feasible, we adapt.
• The Flexibility Factor
• How rigid is the sequencing & grading?
• This refers to whether the materials can be entered at different points or
used in different ways.
Conclusion
Can you now evaluate this framework?
Strengths/weaknesses?
Thank
you
