WHO EMRO - CHILD AND ADOLESCENT HEALTH

Child and Adolescent Health and Development

 

Evaluation and research

Contact us   |   Links |   CAH home  |  EMRO website

Indicators

Surveys and follow-up

Research

 
  • Instrument

  • Follow-up

  • IMCI health facility surveys in the Region

  • Links

.

Instrument

The WHO Department of Child and Adolescent Health and Development in Geneva has developed a manual to assist country programme managers in evaluating the quality of care delivered to sick children attending outpatient facilities (using the IMCI clinical guidelines as best practices). The manual is available at WHO CAH HQ website.

The Child and Adolescent Health and Development Unit (CAH) of the Eastern Mediterranean Regional Office (EMRO) has revised the methodology for use in the Region, taking into consideration: a) previous, extensive experience in the conduct of similar health facility surveys on diarrhoeal diseases and acute respiratory infections; and b) needs for adaptation to the situation in countries in the Region. Major changes concern the collection of:
- Information on not only whether key clinical management tasks are performed but also whether they are performed correctly;
- Additional information on items of particular relevance to a particular country setting (e.g., out-of-pocket health expenditure, relationship of caretakers’ report of breathing signs with pneumonia and care-seeking, etc.)
- Qualitative information, as an additional resource for data analysis to assist in the interpretation of the quantitative data. This information, collected using a semi-structured form, includes observations of the survey team on issues mostly related to health systems support, such as organization of work at the facility, drugs (procurement, uninterrupted supply, etc.), referral, utilization of services, routine reporting, and constraints to the implementation of the IMCI strategy.

The adapted survey forms are available from the reports on the IMCI health facility surveys conducted in the Region. Additional tools have been developed by CAH/EMRO to assist in preparing for the survey, collecting the required data and information for planning. The guidelines “Survey procedures and question-by-question explanations” have been thoroughly revised to include more examples and details to meet the needs in the field (see file on the survey in Sudan).

The survey instruments enable the collection of health facility data on child health service outcome indicators and, together with data on outcome indicators from other sources, are useful to monitor progress towards the achievement of the child health-related Millennium Development Goals. Top

.

Follow-up

A standard methodology has been developed by WHO to conduct follow-up visits after IMCI training. These visits have the objective to reinforce the skills of health providers trained in IMCI, review those health system elements required to support them in the delivery of quality outpatient child health services according to the IMCI strategy, assess caretaker satisfaction with the care received, and identify and help solve problems faced by the trained providers. Staff who conduct follow-up visits receive a standard training on the follow-up methodology and gather information using standard forms. As such, the follow-up visits are at the same time an integral part of training, a strong supervisory tool and a means of collecting information on health provider performance after training. This last aspect is increasingly being used in the Region to assist in monitoring progress towards provider performance targets, set as an intermediate step towards measuring final outcome indicators by other means. While acknowledging that they have some limitations when used for this purpose, follow-up visits offer the advantage of requiring skills already available in a country and less human and financial resources than surveys. Follow-up visits can not replace surveys but may be conducted more frequently than surveys to help guide planning and managers’ decisions. Plans are currently being considered in some countries in the Region to monitor the performance of child health services in facilities in which the IMCI strategy is being implemented, using the methodology of the follow-up visits in samples of facilities. Findings from follow-up visits are reported by country in the IMCI implementation section. Top

.

IMCI health facility surveys in the Region

The CAH unit of the Eastern Mediterranean Regional Office has directly collaborated and been involved in the planning and conduct of health facility surveys on the quality of outpatient child health services in the following countries:

Morocco, October - December 2007

  • Survey at a glance

  • Report

  • Forms (English)

  • Forms (French)

  • Survey procedures and question-by-questions explanations

Sudan, March - April 2003

Egypt, March - April 2002

  • Survey at a glance

  • Report

  • Forms

  • Survey procedures and question-by-question explanation

  • Booklet with graphics

  • Survey at a glance

  • Report

  • Forms

  • Booklet with graphics

 


Morocco

Report
 

National Health Facility Survey on the Quality of Outpatient Primary Child Health Care Services


Morocco
October - December 2007

World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

Full report (pdf, 2.5 MB)

Executive summary (pdf, 146 kb)

Individual sections

Objectives (pdf, 120 kb)

Background (pdf, 181 kb)

Survey methodology (pdf, 183 kb)

Findings (pdf, 500 kb)

Conclusions and recommendations (pdf, 138kb)

Annexes 1-16 (pdf, 330 kb)

Annex 17 (Indicators) (pdf, 157 kb)

Annex 18 (Findings) (pdf, 843 kb)

Appendix: survey forms: English (pdf, 692 kb) -  French (pdf, 796 kb)

 

Survey Procedures and Question-by-Question Explanations
Adaptation for the survey in Morocco
November 2007




World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

Full manual English (pdf, 315kb)

Full manual French (pdf, 319 kb)


Sudan

Report

Health Facility Survey on Quality of Outpatient Child Health Services

IMCI Health Facility Survey
Sudan
March - April 2003

World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

Full report (pdf, 5.74 MB)
Executive summary
(pdf 197 kb )

Individual sections

Click on to expand items

Objectives and background (pdf 251 kb )

1. Objectives

2. Background

2.1 Setting

2.2 Child health indicators

2.3 The response: an integrated child care strategy (IMCI)

Methodology and feedback meetings  (pdf 217 kb )

3. Survey methodology

3.1 Planning

3.2 Geographic scope of the survey and selection of health facilities to survey

3.3 Target age group and timing of the survey

3.4 Survey instruments, teams and procedures for data collection

Forms

Survey teams

Surveyor training

Data collection

3.5 Data entry, cleaning and analysis

3.6 Differences between IMCI follow-up visits and this survey

4. Feedback meetings

4.1 Debriefing with the Federal Minister of Health and Undersecretary of Health

4.2 National feedback meeting

Findings: Sample characteristics (pdf 320 kb )

5. Findings

5.1 Sample characteristics

5.1.1 Characteristics of cases observed and of their caretakers

5.1.2 Patterns of illness

5.1.3 Relationship of caretakers' report of fast or difficult breathing with pneumonia and care-seeking

Findings: Quality of clinical care (pdf 605 kb )

5.2 Quality of clinical care

5.2.1 Assessment

5.2.2 Classification

5.2.3 Treatment and advice

5.2.3.1 Management of severe cases

5.2.3.2 Use of injectable drugs

5.2.3.3 Rational use of oral antibiotics

5.2.3.4 Rational use of oral antimalarials

5.2.3.5 Oral rehydration salts (ORS)

5.2.3.6 Other treatment and opportunities for immunization

5.2.3.7 Advice on follow-up

5.2.3.8 Provider advice and caretaker knowledge about home care

5.2.3.9 Provider communication skills

5.2.3.10 Age-appropriate advice on feeding

5.2.3.11 Use of mosquito bednets and chloroquine at home

5.2.3.12 Advice on mother's health

Findings: Health systems (pdf 423 kb )

5.3 Health systems

5.3.1 Caretaker satisfaction

5.3.2 Organization of work

5.3.3 IMCI training

5.3.3.1 IMCI training coverage

5.3.3.2 Quality of child care by provider training status

5.3.4 Availability and reliability of malaria laboratory

5.3.5 Availability of drugs

5.3.6 Availability of supplies and equipment for vaccination

5.3.7 Availability of other basic supplies and equipment for IMCI

5.3.8 Availability of transportation for referred cases

5.3.9 Health expenditure

5.3.10 Availability of child health services

5.3.11 Supervision

5.3.12 Records

Pre-intervention survey and limitations of this survey (pdf 156 kb )

5.4 Context to interpret findings: the pre-intervention survey

5.5 Limitations of this survey

Conclusions and recommendations (pdf 151 kb )

6. Conclusions and recommendations

6.1 Access to drugs and services: providing equitable access to care to the most vulnerable group

6.2 Training

6.2.1 Skills reinforcement: strengthening follow-up visits after training

6.2.2 Improving basic skills of health providers

6.3 Strengthening malaria laboratory diagnostic capacity

6.4 Organization of work: building capacity and re-distributing selected tasks at health facilities

6.5 Improving supervision and reporting

6.6 Improving care-seeking practices

Annexes

Annexes 1 - 19 (pdf 593 kb )

Annex 1: Areas to be emphasized in future IMCI clinical training and follow-up visits

Annex 2: Main steps of the IMCI process in Sudan

Annex 3: IMCI training and implementation

Annex 4: Schedule of survey activities

Annex 5: Schedule of planning

Annex 6: Survey planning team

Annex 7: Survey selection criteria

Annex 8: Sampling of districts

Annex 9: List of health facilities surveyed

Annex 10: Consideration about timing of the survey

Annex 11: Main survey form adaptations

Annex 12: List of supervisors and surveyors

Annex 13: Surveyor training schedule

Annex 14: Training evaluation form

Annex 15: Survey teams itinerary

Annex 16: Survey procedures for data collection at health facility

Annex 17: List of participants in the national feedback meeting

Annex 18: Minimum survey requirement for drug availability

Annex 19: Findings related to the WHO generic list of IMCI priority indicators (P)
and supplemental measures (S) at health facility level

Annex 20: Findings: Tables and graphs (pdf 2,188 MB )

Appendix: Survey forms (pdf 985 MB )

 

Survey Procedures and Question-by-Question Explanations
Adaptation for the survey in Sudan
March 2003




World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

Full report (pdf, 228kb)

Individual sections

Click on to expand items

PROCEDURES

EC. Enrolment card (pdf 72 kb )

1. FORM 1 (OBSERVATION CHECK-LIST FOR THE SICK CHILD) (pdf 104 kb )

1.1 Overview of Form 1

1.2 General information

1.3 Assessment module

1.4 Classification Module

1.5 Treatment Module

1.6 Communication Module

2. FORM 2 (CARETAKER EXIT INTERVIEW) (pdf 57 kb )

2.1 Overview of Form 2

2.2 Guidelines for completing Form 2 (exit interview)

2.2.1 General information

2.2.2 Questions

3. FORM 3 (RE-EXAMINATION OF CHILD 2 MO-5 YRS) (pdf 61 kb )

3.1 Overview of Form 3

3.2.1 General information

3.2.2 Assessment and classification

4. FORM 4 (FACILITY EQUIPMENT AND SUPPLY CHECKLIST) (pdf 50 kb )

4.1 Overview of the instrument

4.2 General information

4.3. Equipment and supplies Module

4.4. Availability of drugs Module

4.5. Facility services Module

4.6 Facility records Module
5. OBSERVATION SHEET (pdf 20 kb )

Booklet with graphics

IMCI Health Facility Survey

Sudan
March - April 2003

World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

Full booklet (pdf, 665 KB)

Individual sections

Click on to expand items

OBJECTIVES AND METHODOLOGY   (pdf 49 kb )

Objectives

Selection of health facilities

Distribution of health facilities in the sample by location and type

SURVEY FINDINGS

I. Sample characteristics (pdf 100 kb )

Sample characteristics

Cases managed by type of health provider

II. Quality of clinical care

Assessment (pdf 167 kb )

Distribution of main conditions identified in the sample

Integrated assessment (1): Main tasks and index

Integrated assessment (1): Main tasks and index Trained vs untrained

Performance of selected tasks: Taking temperature and weight

Performance of selected tasks: Taking temperature and weight Trained vs untrained

Performance of selected tasks: ARI and diarrhoea

Performance of selected tasks: ARI and diarrhoea Trained vs untrained

Assessment of feeding practices: children less than 2 years old and older children with very low weight and/or anaemia

Assessment of feeding practices in the target group Trained vs untrained

Classification (pdf 71 kb )

Agreement of provider's classifications with surveyor's classifications on main conditions

Agreement on classifications Trained vs untrained

Treatment and advice  (pdf 321 kb )

Management of severe cases needing urgent referral: severe cases identified and referred

Prescription of recommended oral antibiotic treatment (IMCI conditions)

Prescription of recommended oral antibiotic treatment (IMCI conditions) (1) Trained vs untrained

Prescription of recommended oral antibiotic treatment (IMCI conditions) (2) Trained vs untrained

Caretaker correct knowledge about oral antibiotic treatment (IMCI conditions) Trained vs untrained

Caretaker's potential compliance with provider's advice on duration of oral antibiotic treatment should child get better before completing treatment course

Rational use of drugs: Cases not needing antibiotics given no antibiotics

Rational use of drugs Trained vs untrained

Prescription of oral antimalarial treatment

Prescription of oral antimalarial treatment Trained vs untrained

Prescription of oral antimalarials Trained vs untrained

Other treatments for non-referred cases

Caretaker correct knowledge about antimalarial treatment Trained vs untrained

Advice on ORS Trained vs untrained

Caretaker knowledge about ORS preparation and administration Trained vs untrained

Other curative and preventive treatments and opportunities for immunisation for non-referred cases

Cases given advice on home care by provider and caretaker knowledge

Advice on home care given by provider Trained vs untrained

Caretakers advised on signs to return immediately and knowing about them

Caretakers given age-appropriate advice on frequency of feeding

Mosquito bednets and their use

Use of home care card and communication techniques

Use of home care card and communication techniques Trained vs untrained

III. Factors influencing care (pdf 47 kb )

Drug availability

Index (mean) of drug availability

Availability of supply and equipment for IMCI

Availability of supply and equipment for immunization

Availability of key supply and equipment for malaria laboratory

Availability of IMCI records, counselling cards, chart booklet and other records

Supervision in the 66 facilities visited

CONCLUSIONS and RECOMMENDATIONS


Egypt

Report

Health Facility Survey on Outpatient Child Care (IMCI) Services

Egypt
March 2002


World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

. Full report (pdf, 3.46 MB)

Executive summary (pdf, 18 kb)

Individual sections

Click on to expand items

Objectives and background (pdf 44 kb)

1. Objectives

2. Background

2.1 Setting

2.2 Child health indicators

2.3 The response: an integrated child care strategy (IMCI)

Methodology (pdf 41 kb)

3. Survey methodology

3.1 Planning

3.2 Geographic scope of the survey and selection of health facilities to survey

3.3. Survey procedures and instruments

3.4 Training of surveyors and supervisors

3.5 Data collection

3.6 Data entry, cleaning and analysis

3.7 Review meeting

Findings: Sample characteristics  (pdf 421 kb)

4. Survey findings

4.1 Sample characteristics

4.1.1 Characteristics of cases observed and of their caretakers

4.1.2 Patterns of illness

4.1.3 Relationship of caretakers' report of fast or difficult breathing with pneumonia

Findings: Quality of clinical care (pdf 941 kb)

4.2 Quality of clinical care

4.2.1 Assessment

4.2.2 Classification

4.2.3 Treatment and advice

Findings: Health systems (pdf 370 kb)

4.3 Health systems

4.3.1 Caretaker satisfaction

4.3.2 Organization of work

4.3.3 Provider IMCI training status

4.3.4 Availability of drugs

4.3.5 Availability of supplies and equipment for vaccination

4.3.6 Availability of other basic supplies and equipment for IMCI

4.3.7 Availability of transportation for referred cases

4.3.8 Availability of child health services

4.3.9 Supervision

4.3.10 Records

Differences between IMCI follow-up visits and this survey, and limitations of this survey  (pdf 28 kb)

4.4 Differences between IMCI follow-up visits and this survey

4.5 Limitations of this survey

Conclusions and recommendations (pdf 18 kb)

5.1 Training

5.1.1 Turnover of trained staff

5.1.2 The challenge of long-term sustainability

5.2 Iron-deficiency anaemia

5.3 Care-seeking and home care practices

5.4 Supervision

5.4 Drug expenditure

Annexes

Annexes 1-13 (pdf 254 kb)

Annex 1: Areas to be emphasized in future IMCI clinical training and skill reinforcement and follow-up visits

Annex 2: Main steps of the IMCI process in Egypt

Annex 3: IMCI training and implementation coverage

Annex 4: Schedule of survey activities

Annex 5: Geographical areas and health facilities selected for the survey

Annex 6: List of health facilities replaced during field work

Annex 7: List of surveyors and supervisors

Annex 8: Surveyor training schedule

Annex 9: Participant training evaluation

Annex 10: Survey teams and itinerary

Annex 11: Facility procedures on data collection

Annex 12: National feedback meeting: agenda and participants

Annex 13: Findings related to the WHO generic list of IMCI priority indicators (P) and supplemental
measures (S) at health facility level

Annex 14: Findings: tables and graphs  (pdf 549 kb)

Appendix: Survey forms (pdf 290 kb)

Booklet with graphics

IMCI Health Facility Survey

Egypt
10 March - 10 April 2002

World Health Organization
Regional office for the Eastern Mediterranean
Child and Adolescent Health and Development

Full booklet (pdf, 659 KB)

Individual sections

Click on to expand items

OBJECTIVES AND METHODOLOGY (pdf 71 kb)

Objectives

Selection of health facilities

Type of health facilities selected

Enrolment criteria

Sequence at health facility

SURVEY FINDINGS  (pdf 581 kb)

I. Sample characteristics

II. Quality of clinical care

Assessment (pdf 135 kb)

Distribution of the IMCI conditions identified in the sample

Integrated assessment (1): Main tasks and index

Integrated assessment (2): Other tasks

Performance of selected tasks: Taking temperature and weight

Performance of selected tasks: ARI and diarrhoea

Performance of selected tasks: Throat and ear problems

Performance of selected tasks: Anaemia and measles

Assessment of feeding practices in non-referred children with low weight and/or anaemia and those less than 2 years old

Classification (pdf 115 kb)

Agreement of provider classifications with surveyor classifications on conditions present

Provider's agreement with surveyor's classifications by illness group

Treatment and advice (pdf 264 kb)

Oral antibiotic treatment: Correct prescription for non-referred cases with an IMCI condition

Rational use of drugs for children not needing antibiotics

Other treatments for non-referred cases

Caretakers advised by provider on antibiotics and ORS

Caretaker's correct recall of provider's advice on antibiotics and ORS

Caretaker's potential compliance with provider's advice on antibiotic treatment should child get better
before completing treatment course

Caretakers advised on fluids and feeding and correctly knowing about them

Caretakers advised on signs to return immediately and knowing about them

Caretakers given age-appropriate advice on frequency of feeding

III. Factors influencing care (pdf 113 kb)

Caretaker satisfaction

Caretakers satisfied with child care services at the facility

Reasons for caretakers' satisfaction with services

Distribution of tasks

Performance of selected tasks by type of provider

Drug availability

Index (arithmetic mean) of drug availability

Availability of ORS and antibiotics recommended for IMCI

Availability of other supplies

Availability of supply and equipment for IMCI

Availability of IMCI records, counselling cards and chart booklet

Supervision

Supervision in the 50 facilities visited

Use of services by age and sex

Consultations by age group and sex in children under-five

CONCLUSIONS and RECOMMENDATIONS (pdf 28 kb)

 
.

Links

United Nations Children’s Fund (UNICEF)
Home page | Multiple Indicator Cluster Surveys (MICS) country reports, MICS tools and other useful information.

Macro International Inc
MEASURE DHS+
The site contains information on hundreds of Demographic and Health Surveys (DHS), other quantitative surveys and qualitative surveys
 

World Bank
Home page |  Health, Nutrition, Population Statistics by countries (access to HNPStats)

 Top