Evaluate A Learning Intervention Using Given Evaluation Instruments
Evaluate A Learning Intervention Using Given Evaluation Instruments
SGB Occupationally-directed
ETD Practitioners
FIELD SUBFIELD
2016-06-30 2019-06-30
In all of the tables in this document, both the pre-2009 NQF Level and the NQF Level is
shown. In the text (purpose statements, qualification rules, etc), any references to NQF
Levels are to the pre-2009 levels unless specifically stated otherwise.
US Pre-2009 Replacement
Unit Standard Title NQF Level Credits
ID NQF Level Status
Evaluation is the systematic process of gathering and analysing data and other objective
information to determine the quality, value and effectiveness of a learning intervention
within the context of the organisational setting with the specific aim of initiating certain
actions.
The assessment of candidate-evaluators will only be valid for award of this unit standard
if the following requirements are met:
The learning intervention being evaluated leads to a significant, meaningful and
coherent outcome of learning that is in line with SAQA's definition of competence i.e.
embraces foundational, practical and reflexive dimensions of competence. Although this
is not a rule, for the purposes of this unit standard the learning intervention being
evaluated should be of a size that generally requires in the region of 50 - 80 hours of
learning time.
The learning intervention being evaluated includes learning of tasks and concepts.
Therefore interventions that relate only to highly task-orientated learning and do not
demand much, if any, in the way of reflexive competence, will not provide enough scope
for the evaluator to prove competence in this unit standard.
The evaluation is to cover at least the following: learning outcomes, learning design,
delivery, application of learning, assessment, internal moderation; support services,
administration; learning environment; and stakeholder satisfaction. Where possible, the
evaluation is to include a consideration of return on training investment and impact in the
workplace.
The evaluation may be for interventions using any one of the following modes of
delivery:
1. Distance.
2. Formal classroom-based training.
3. On-the job training.
For the purposes of this unit standard, evaluators may use given evaluation
instruments and processes. However evaluators will need to be able to adjust the
instruments and process for the particular purpose to which they are applied.
SPECIFIC OUTCOME 1
Plan and prepare for the evaluation.
ASSESSMENT CRITERIA
ASSESSMENT CRITERION 1
The purpose and scope of the evaluation is defined in terms of stakeholder
requirements.
ASSESSMENT CRITERION RANGE
Stakeholders - combinations of: provider, client organisations, funders, government
agencies, accrediting bodies, learners.
ASSESSMENT CRITERION 2
Evaluation criteria are confirmed as objective, measurable, sufficient and suited to the
agreed purpose of the evaluation. The criteria are confirmed to be aligned with the
organisational quality assurance system.
ASSESSMENT CRITERION 3
Evaluation instruments selected make use of strategies, methodologies, research
methods and information sources that are appropriate to the purpose and context of the
evaluation.
ASSESSMENT CRITERION RANGE
Research methods - qualitative and quantitative:
Information sources could include learners, teaching staff, learning support staff,
administrative staff and administrative data, learning materials, learner records, course
evaluations, facilitator reports, records of results, professional associations.
ASSESSMENT CRITERION 4
Evaluation instruments selected enable valid, sufficient and reliable data to be generated
within time and budgetary constraints, and to achieve the purposes of the evaluation.
ASSESSMENT CRITERION RANGE
Instruments can include the following data gathering techniques: questionnaires,
interviews, focus groups, observation.
ASSESSMENT CRITERION 5
Evaluation instruments are adjusted to ensure they will generate the data that are
required to achieve the evaluation purpose.
ASSESSMENT CRITERION 6
The plan is developed providing details of the purpose and subject of the evaluation,
roles and responsibilities of participants, sample sizes, frequency and timing of data
gathering, venue/s, logistics, resource requirements and reporting mechanisms.
ASSESSMENT CRITERION 7
The evaluation plan is agreed with relevant stakeholders, and enables the achievement
of the evaluation purpose within time and budgetary constraints.
SPECIFIC OUTCOME 2
Collect and record data.
ASSESSMENT CRITERIA
ASSESSMENT CRITERION 1
Data are collected and recorded in accordance with the evaluation plan.
ASSESSMENT CRITERION RANGE
Timing, target groups, tools.
ASSESSMENT CRITERION 2
Data are collected from a representative sample of the target group in accordance with
the evaluation plan.
ASSESSMENT CRITERION RANGE
A representative sample contains sufficient numbers and coverage to appropriately
reflect the target group, and produce valid and reliable data.
ASSESSMENT CRITERION 3
Data are collected in relation to key quality indicators, including cost, time, outcomes
achieved and manageability.
ASSESSMENT CRITERION 4
Data are recorded without errors or omissions.
SPECIFIC OUTCOME 3
Analyse and interpret data.
ASSESSMENT CRITERIA
ASSESSMENT CRITERION 1
The sorting and summarising of data into categories validly reflect the evaluation
purpose and serve to focus attention on particular areas.
ASSESSMENT CRITERION RANGE
Learning outcomes, learning design, delivery, assessment, internal moderation; support
services, administration; learning environment; application of learning and stakeholder
satisfaction.
ASSESSMENT CRITERION 2
Data are displayed in a way that aids analysis and interpretation.
ASSESSMENT CRITERION 3
Identified trends, patterns, and comparisons validly reflect the data.
ASSESSMENT CRITERION 4
Interpretations of data are consistent with the data and are free of bias.
ASSESSMENT CRITERION 5
Findings are unbiased reflections of the data and are supported by evidence.
SPECIFIC OUTCOME 4
Compile an evaluation report.
OUTCOME RANGE
The report would typically include a summary, background information, the evaluation
purpose, evaluation methodology, findings, possible solutions and recommendations.
ASSESSMENT CRITERIA
ASSESSMENT CRITERION 1
The summary and presentation of results validly reflect the data and are in a form that is
meaningful to recipients.
ASSESSMENT CRITERION 2
Limitations of data interpretation are made explicit.
ASSESSMENT CRITERION 3
Evaluation results are compared with related external data where available so that valid
conclusions can be drawn.
ASSESSMENT CRITERION RANGE
External data can include, but are not limited to - previous evaluations, internal and
external benchmarks.
Valid means fit for purpose, and relating solely to the attributes or data being
evaluated.
ASSESSMENT CRITERION 4
Raw data are made available in an organised form that can be accessed by recipients
within the constraints of relevant policy and legislation.
ASSESSMENT CRITERION 5
Recommendations are formulated in consultation with relevant stakeholders, and are
relevant to the context, feasible, can be justified in terms of the findings and evaluation
purpose, and promote the improvement of learning interventions.
SPECIFIC OUTCOME 5
Review the evaluation process.
ASSESSMENT CRITERIA
ASSESSMENT CRITERION 1
The process is analysed in terms of strengths, weaknesses and fitness for purpose.
ASSESSMENT CRITERION 2
Opportunities and mechanisms to improve upon the process are identified and recorded
for integration into future evaluations.
Providers of learning towards this unit standard must be accredited through the
relevant ETQA by SAQA, or with an ETQA that has a Memorandum of Understanding
with the appropriate ETQA.
PRE-
QUALITY
QUALIFICATION 2009 NQF END
ID STATUS ASSURING
TITLE NQF LEVEL DATE
BODY
LEVEL
National
Certificate:
Occupationally
New Level
Directed 2015-
Core 50334 Level 5 Assignment Reregistered ETDP SETA
Education 06-30
Pend.
Training and
Development
Practices
National Diploma:
Occupationally
Directed
NQF Level 2015-
Core 50333 Education, Level 5 Reregistered ETDP SETA
05 06-30
Training and
Development
Practices
Bachelor:
As per
Occupationally
Learning
Directed
NQF Level 2015- Programmes
Core 50330 Education Level 6 Reregistered
07 06-30 recorded
Training and
against this
Development
Qual
Practices
Core 50331 National Level 6 New Level Reregistered 2015- ETDP SETA
Certificate:
Occupationally
Directed
Assignment
Education, 06-30
Pend.
Training and
Development
Practices
National
Certificate:
Environmental New Level
2015-
Elective 22901 Education, Level 5 Assignment Reregistered ETDP SETA
06-30
Training and Pend.
Development
Practice
National Diploma:
Environmental
Education, NQF Level 2015-
Elective 22902 Level 5 Reregistered ETDP SETA
Training and 05 06-30
Development
Practice
All qualifications and part qualifications registered on the National Qualifications Framework
are public property. Thus the only payment that can be made for them is for service and
reproduction. It is illegal to sell this material for profit. If the material is reproduced or quoted,
the South African Qualifications Authority (SAQA) should be acknowledged as the source.