Key concepts in evaluation

Page 3/4

If you are new to evaluation, here are some of the key ideas you will need to understand.

Use your mouse or keyboard to expand each of the headings below.

What is evaluation?

We use the term “evaluation” to mean a process, either formal and highly structured or more informal, that assesses a CBR programme with respect to agreed criteria, essentially the key characteristics of a good programme. Monitoring and evaluation go hand in hand, so the features of the programme that are monitored will also be those that are evaluated. There are many schemes available for monitoring and evaluating programmes like CBR that combine service delivery with community development and empowerment. WHO uses the following scheme based on the building blocks of health systems. The relevant questions that we ask for programme evaluation are these.

  • Were the activities planned sufficient to achieve our outcomes and were they successfully carried out (comprehensiveness)?
  • Were all activities provided in ways that people could access (accessibility)?
  • Did the activities include everyone in our target population (coverage)?
  • Did our activities have outcomes that linked up with other services and opportunities in the community (continuity)?
  • Were our services and interventions effective, safe, timely and centred on people’s needs (quality)?
  • Were our activities focused on the individuals we hoped to serve (person-centredness)?
  • Were our activities coordinated across other community activities (coordination)?
  • Were our activities well-managed, efficient, not wasteful of resources, and accountable to the community (accountability and efficiency)?

No evaluation could address all of these key characteristics of a programme, so in practice an evaluation will be geared towards one or a few of them as its primary focus or purpose.

Who does the evaluation?

Evaluations can be carried out:

  • internally, by staff involved in the CBR programme (self-evaluation);
  • externally, by an independent, outside individual or agency (external evaluation);
  • as a participatory effort, involving disabled people’s organizations, CBR staff and an external evaluation specialist.

There are advantages and disadvantages to each approach, and so approaches to evaluation can vary from programme to programme. The best approach is for the evaluation to be carried out using a combination of two or more of the approaches. Regardless of the approach used, it is important that people with disabilities are able to participate actively in evaluation activities.

Poll question: If your organization is already conducting evaluation activities, which of the following are involved in these evaluation efforts? Select all that apply; select Vote when you are finished.

When does the evaluation take place?

Evaluation is different from monitoring because it is not carried out continuously, although it is based on the information that is collected during the monitoring process. Evaluation may take place

  • midway through the implementation of the programme
  • immediately after the programme’s completion; or
  • some time afterwards, perhaps several years later to assess longer-term impact.