WHO EMRO - CHILD AND ADOLESCENT HEALTH

Child and Adolescent Health and Development

 

Evaluation and research

Contact us   |   Links |   CAH home  |  EMRO website

Indicators

Surveys and follow-up

Research

 
  • Two main “families” of programme indicators

  • Process indicators

  • Outcome indicators

  • Examples of the logical flow of indicators

  • Indicators on child health

 

 

Two main "families" of programme indicators

 
A programme indicator is basically a number, proportion, percentage or rate that suggests or “indicates” the extent to which planned activities have been conducted (process and output indicators) and programme achievements have been made (outcome and impact indicators)
[1].
 

-- Downloads --

Section on “Planning: targets and indicators” from the “Framework for the community component of the integrated child care strategy” (pdf, 63 kb)

Presentation on “Indicators and targets” with examples on the logical flow of indicators (PowerPoint 232 kb)

Presentation on logical flow of indicators
(PowerPoint 188 kb)

These two families of indicators, very broadly defined, are briefly described below[2]. The key message of this section is that plans should always include clear and measurable indicators that go beyond monitoring the “process” to include also the “outcome”, that is what the intervention should lead to, in relation to the main reason why certain activities have originally been planned. For example, training courses may be planned on counselling on child care. This is done: à to improve health providers’ counselling skills à to increase caretakers’ knowledge of child care à to improve caretakers’ child care practices (outcome) à to improve child health, e.g. reducing child deaths, illness or improving child growth and development (impact). Top

EXAMPLE. In the case of a training course on counselling, indicators to monitor the quality of training may refer to the ratio of facilitator to participant, percentage of total time spent practising the counselling skills and number of caretakers counselled per participant, proportion of participants trained that were followed up with skill reinforcement visits within 4 weeks of training, etc.

 
 
 

Process indicators

Process indicators refer to quantitative indicators selected to determine whether planned activities took place, e.g. holding of a meeting with NGOs, development and testing of health education materials or conduct of communication skills training courses for community volunteers. In this category one may include also output indicators, which are those adding more details in relation to the output of the activity, e.g. the number and categories of community health providers trained in communications skills, the number of printed materials or radio programmes for health education developed, the number and type of radio spots produced and broadcast. Indicators can also be selected to monitor the quality of the activities conducted according to a number of established quality criteria or standards.

These indicators are useful management tools to monitor implementation: related targets should be set for them during the planning process and included in the plan. Targets must always be quantified: e.g., if the indicator is “proportion of community health volunteers trained in breastfeeding counselling”, the target would be expressed as “50% of the community health volunteers in the districts implementing IMCI will have been trained in breastfeeding counselling by the end of 2003”. These targets, however, are limited to aspects of quantity (“how much”, "how many") and do not provide information on the result and impact of the activity. For this, another set of indicators is needed, “outcome” indicators. Top

.

Outcome indicators

Outcome indicators refer more specifically to the objectives of the intervention, that is its ‘results’, its outcome, the adoption of the recommended practice. These indicators indicate the reason why it was decided to conduct certain activities and are related to performance.

EXAMPLE. If the reason for an intervention consisting of training health providers in IMCI is to improve the management of sick children under 5 years old, the outcome indicator in this case would then be expressed as “the proportion of trained community health volunteers who manage a sick child correctly according to the IMCI guidelines”. If the objective of the intervention is to improve home care of sick children, an outcome indicator could be “the proportion of mothers who adequately care for ill children”. If the objective is to improve child psychosocial development, an outcome indicator could be “the proportion of mothers who play and communicate effectively with their children”.


These indicators, therefore, allow us to know whether the desired outcome has been generated. Targets for outcome indicators should be set and included in the plan. However, it takes time before final outcomes can be measured. A number of intermediate outcome indicators should therefore be identified—and related targets set—for all the intermediate changes that the intervention is expected to bring about and that will eventually lead to the final outcome, in order to help us know whether we are progressing towards achieving the expected outcome.

It is obvious that the target set for the final outcome indicator should be based on the targets for the process indicators and intermediate outcome indicators. For instance, in the example above, let us assume that in the pre-intervention phase only 20% of mothers are found to have good knowledge of how to care for a sick child. If it is planned to train 30% of all health providers in a community in counselling on home care, it would be unrealistic to expect all (100%) mothers in the community to receive good counselling, to have good knowledge of home care and care for their children properly as a result of the training intervention.

These indicators, therefore, are of utmost importance. They should be monitored on a regular basis and plans for monitoring them should be included in the master plan for the intervention. Monitoring can include routine data collection, home visits, in-depth individual interviews, focus group discussions, observation of practices, intercept interviews, etc. It provides information not only about what is happening but also about why things are or are not happening. Monitoring of these indicators will tell us how the intervention needs to be modified during implementation. Communities should be involved in identifying solutions to the problems identified in the monitoring. An analysis of the progress towards achieving the targets set for these indicators will provide information valuable for the intervention and for future planning. Top

.

Examples of the logical flow of indicators

View the examples illustrating the logical “flow of indicators” from process to outcome and impact. It is understood that more than one strategy is often needed to achieve a certain objective, especially if the objective concerns changes in family practices, and each strategy needs clear indicators and targets of its own. However, in the following examples, each example shows only one set of indicators per intervention, in order to illustrate the logic of the “flow” and keep the examples simple and straightforward. Top

Example 1

Example 2

Example 3

Improving care of children under 5 years old with diarrhoea in the home through training of community health volunteers in child home care

Improving exclusive breastfeeding practices for children less than 6 months old through training of community health workers in breastfeeding counselling

Improving care-seeking practices for children under 5 years old with acute respiratory infections through radio campaign

Slide 1  Counselling to improve care-seeking for children with pneumonia
(PowerPoint, 123 kb)

Slide 2  Advice on ORS preparation to improve home care for children with diarrhoea
(PowerPoint, 123 kb)

Slide 3  IMCI nutritional counselling to increase weight gain
(PowerPoint, 37 kb)

Slide 4  IMCI training to increase opportunities for immunization
(PowerPoint, 123 kb)

.

Indicators on child health

World Health Organization, Department of Child and Adolescent Health and Development, Geneva

WHO IMCI indicators at primary health care facility and household levels

  • Child Survival Survey-based Indicators
    Joint UNICEF/WHO meeting
    17-18 June 2004

    This document reports on the minimal set of key population-based indicators—to be measured through household surveys—for monitoring progress towards the child survival related goals, using the set of prevention and treatment interventions described in the Lancet series on child survival as a framework. The list was developed in a joint WHO/UNICEF meeting, with the participation of other key organizations and institutions. It is meant to serve as a reference for the revision of the Multiple Indicator Cluster Survey (MICS) and the Demographic and Health Survey (DHS) household questionnaires.
     

  • The Interagency Working Group on IMCI Monitoring and Evaluation
    (BASICS, CDC, UNICEF, USAID, WHO)
    Rev1, June 2001

    This site provides information on the priority indicators and supplemental measures for IMCI at health facility and household levels. The list was developed by the Department in collaboration with “The Interagency Working Group on IMCI Monitoring and Evaluation” (BASICS, CDC, UNICEF, USAID, WHO) and revised in June 2001. Health facility indicators include indicators on both health worker’s skills and health system supports for IMCI.

The following two links display Annex D and E, respectively, of the WHO IMCI health facility survey manual, listing the IMCI priority and supplemental indicators that can be measured through this survey tool:

Annex D (priority indicators)

Annex E (supplemental measures) 

Indicators for assessing infant and young child feeding practices 

This document reports the conclusions of a consensus meeting held in Washington DC, USA, 6-8 November 2007, on indicators to assess infant feeding. The indicators include 8 core indicators and 7 optional indicators, are population-based and can be derived from household survey data. Developments in knowledge and recommendations in this area prompted the revision and expansion of the indicators which had been developed earlier and which are described in the two documents below on breastfeeding practices (1991) and complementary feeding (2002), respectively.

Indicators for assessing breastfeeding practices

This “Report of an informal meeting on indicators for assessing breastfeeding practices” held in Geneva on 11-12 June 1991 [WHO/CDD/SER/91.14] provides the rationale for the selection of key breastfeeding indicators, lists their definitions and describes specific methodologies for their measurement at household level.

Indicators for complementary feeding

This “Report of an informal meeting to Review and Develop Indicators for Complementary Feeding, held in Washington DC on 3-5 December 2002 describes a set of indicators for assessing complementary feeding.

For other information on complementary feeding, consult the full nutrition section of the CAH/HQ website.  Top


[1] Adapted from CDD/ARI programme management, a training course: introduction. Division of Diarrhoeal and Acute Respiratory Disease Control [CDR], Geneva, World Health Organization, 1995. Back
[2] Many types of indicators have been defined, including process, input, output, outcome and impact indicators. For the purpose of simplification and clarity, they have been grouped in this section into two main ‘families’ of indicators. Back