Eastern Mediterranean Health Journal | All issues | Volume 24, 2018 | Volume 24, issue 7 | Engagement of health research institutions in knowledge translation in the Eastern Mediterranean Region

Engagement of health research institutions in knowledge translation in the Eastern Mediterranean Region

Print PDF

PDF version

Fadi El-Jardali,1 Ahmed Mandil,2 Diana Jamal,1 Lama BouKarroum,1 Samar El-Feky,2 Mohamed Nour 2 and Mazen Al-Abbar 1

1Department of Health Management and Policy, American University of Beirut, Beirut, Lebanon 2WHO Regional Office for the Eastern Mediterranean,

Cairo, Egypt. (Correspondence to: Fadi El-Jardali: This e-mail address is being protected from spambots. You need JavaScript enabled to view it ).

Abstract

Background: Health research institutions in the Eastern Mediterranean Region (EMR) can play an integral role in promoting and supporting Knowledge Translation (KT). Assessing institutions’ engagement in KT and bridging the “research-

policy” gap is important in designing context-specific strategies to promote KT and informing funding efforts in the region.

Aims: The objective of this study was to explore the engagement of EMR institutions in KT activities.

Methods: A cross-sectional survey of institutions undertaking health research in the 22 EMR countries was undertaken.

The survey covered institutional characteristics, institutional planning for research, national planning for health research, and knowledge management, translation and dissemination.

Results: 575 institutions were contacted of which 223 (38.3%) responded. Half the sampled institutions reported conducting priority-setting exercises, with 60.2% not following a standardized approach. Less than half institutions reported frequently/always (40.5%) involving policymakers and stakeholders in setting priorities for research on health. Only 26.5% of respondent institutions reported that they examine the extent to which health policymakers utilize their research results. Moreover, only 23.3% reported measuring the impact of their health research.

Conclusions: There is still misalignment between national health research priorities and actual research production, and KT activities are still rarely undertaken by institutions in the EMR. National governments and international funding agencies are called to support research production and translation in the EMR. Institutions and researchers are also called to produce policy-relevant research and be responsive to the needs and priorities of policy-makers.

Keywords: knowledge translation, Eastern Mediterranean Region, research institutions, health research, health policy

Citation: El-Jardali F; Mandil A; Jamal D; BouKarroum L; El-Feky S; Nour M; et al. Engagement of health research institutions in knowledge translation in the Eastern Mediterranean Region. East Mediterr Health J. 2018;24(7):672–679. https://doi.org/10.26719/2018.24.7.672

Received: 12/01/18; accepted: 08/08/18

Copyright © World Health Organization (WHO) 2018. Some rights reserved. This work is available under the CC BY-NC-SA 3.0 IGO license (https:// creativecommons.org/licenses/by-nc-sa/3.0/igo).


Introduction

The role of evidence-informed health policies in improving health systems, and reducing inequity is increasingly recognized. There is a need support the translation of evidence to action across decision-making interfaces and embedding research within policy-making processes and practice (1,2). The World Health Report 2013 emphasized the crucial role of translating evidence into policies in supporting health in general and attaining Universal Health Care coverage in particular (3). One of the strategies that emerged from the report was to support the knowledge translation (KT) of evidence to policies and actions. KT is defined as “a dynamic and iterative process that includes the synthesis, dissemination, exchange and ethically sound application of knowledge to improve health, provide more effective health services and products, and strengthen the health care system” (4).

Despite global calls, the work on KT and utilization of research in policy-making is still limited in the Eastern Mediterranean Region (EMR). A recent survey of researchers in the EMR showed that only 15% produced policy briefs, disseminated messages that specified possible actions (24%), interacted with policy-makers and stakeholders in priority-setting (16%), and involved them in their research (20%) (5). Another survey of policy-makers revealed that less than 43.1% collaborated with researchers and less than half reported that research is not delivered at the right time, lacks actionable messages (35.5%), and lacks information about research quality and local applicability (40.1%) (6).

Health research institutions in the EMR can play an integral role in promoting and supporting KT. Assessing institutions’ engagement in KT and in bridging the “research-policy” gap is important in designing context-specific strategies to promote KT and informing funding efforts in the Region. There are scarce, if any, previous regional surveys that document engagement of institutions undertaking health research in the EMR in KT. Previous studies focusing on knowledge translation were country specific and not regional in nature (7). The objective of this study was to explore engagement of EMR institutions undertaking health research in KT with emphasis on institutional planning for research, national planning of health research and knowledge management, translation and dissemination.

Methods

A cross-sectional survey of institutions undertaking health research in all 22 EMR Member States was conducted from August 2015 to July 2016. The survey was developed based on various sources (1,8–15). The survey included 10 sections, of which four are discussed in this paper, and are: institutional characteristics; institutional planning for research (adapted from El-Jardali et al. [4–5] and Kennedy et al. [10]); national planning of health research (adapted from Tugwell et al. [8], Kennedy et al. [10], World Health Organization [11], and Ismail et al. [9]); and knowledge management, translation and dissemination (adapted from Lavis et al. [13], Campbell et al. [15] and Gholami et al. [14]). The survey was pilot-tested to ensure validity and reliability and the time of completion was estimated using a guiding protocol for pilot testing.

Data were collected through trained focal people identified by the World Health Organization Regional Office for the Eastern Mediterranean (WHO/EMRO) in each of the study countries. The surveys were administered in English electronically through email.

Data were analysed using Statistical Package for the Social Sciences (SPSS) version 24. Questions were analysed based on country income level, facility type and sector. Thematic analysis was used for the open-ended questions whereby data was coded and then categorized by most recurrent themes.

Results

A total of 575 institutions were contacted across 22 countries in the EMR of which 223 (38.8%) from 22 countries responded to the survey.

Institutional characteristics

The majority of sampled institutions were academic research centres / institutes (44.7%). Organizational sectors were mostly public (64.2%) while only 10.6% were private. Most organizations were public of which 68% had less than 20 years of experience. A total of 40% of non-academic research centres/institutes were non-governmental organizations (NGOs).

Institutional planning for research for health

Funding types and sources

The majority of institutions submitted less than 10 proposals to national, regional or international sources, and mainly in response to calls for proposals. Institutions received less than 10 grants regardless of funding source. Institutions within low–middle income countries were most likely to receive funding for less than 10 proposals (83.1%). Moreover, non-academic research centres were least likely to receive funding from regional sources (80%).

Priority setting

Half of the sampled institutions reported conducting priority setting exercises. Even when conducting priority-setting exercises, 60.2% reported not following a standardized priority setting methodology. When asked about methodologies, responses were diverse and not reported descriptively by many institutions in this survey. Some reported conducting literature reviews, focus groups, or surveys without elaborating on the exact methodology. Less than half of the institutions reported frequently / always (40.5%) involving policy-makers and stakeholders when setting priorities for research on health (Table 1). Moreover, 43.1% frequently/always translate high-priority policy concerns into priority research on health themes and/or questions. It was not clear how often institutions made an up-to-date list of the country’s research on health priorities to be available to researchers/scientists. It was also unclear how often institutions involved policy-makers and stakeholders in research projects (Table 1).

National planning for health research

Similar numbers of institutions reported knowing (49.1%) and not knowing (43.8%) whether their countries have national health research priorities. The overwhelming majority of proposals did not address national health research priorities (70.2%). Topics mainly included noncommunicable diseases (NCDs), maternal and child health, cancer, reproductive healthcare and mental health. Upper–middle income countries were most likely to report not having national health research priorities, whereas low–middle income countries were most likely to report not knowing whether their countries had national health research priorities.

Recognition and coordination of national health priorities

Institutions indicated that funders occasionally (35.4%), or frequently (23.9%) formulate their priorities and calls for proposals for research for health in response to national / regional needs. Half the respondents (48.2%) did not know whether their countries had a national health council that regulates funding priorities. Only 29.2% of institutions were involved in a national priority setting exercise between 2010 and 2014, held either by the institution itself, or in collaboration with WHO, ministries of health or national research councils.

A little over half of responding institutions reported that their country’s ministry of health has a department that coordinates health research (55.8%) and less than half reported having a national health sector strategy (46.9%). Around half of responding institutions did not know whether their countries had legislation that deals with health research (55.4%). However, 57% reported that their countries had a national ethical review committee (Table 2).

Knowledge management, translation and dissemination

Dissemination of research findings

Institutions reported mostly disseminating their research findings through seminars and conferences (64.1%), peer-reviewed scientific journals (58.8%), and institutional websites (58.7%). Those methods reported to be never or rarely used included policy briefs (48.4%), policy dialogues (48.4%), letters/briefs/tailored messages to policy-makers/stakeholders (39.9%), and institution-owned, peer-reviewed scientific journals (40.4%) (Table 3). Other means of dissemination included media briefings, presentations to stakeholders, and lectures among others. The majority of institutions (72.2%) reported disseminating health research findings within their institutions, sometimes referred to as “permeability of information”. Methods for dissemination included seminars, conferences, dissemination on website, newsletters, journal articles, and journal clubs, among others.

Knowledge transfer and translation

Institutions reported that they most frequently transfer/translate knowledge to the following categories: other academic faculties / schools / institutes / departments (39.9%); policy-makers in the government (36.3%); healthcare providers (36.3%); and directors in health care institutions (34.1%). Knowledge transfer and translation was reported to be never or rarely conducted with directors in NGOs (53.8%); directors in international agencies (55.2%); directors in donor agencies (64.1%); and general public or healthcare recipients (43.9%) (Table 3). Knowledge transfer and translation was least reported by high-income countries to policy-makers (26.7%) and directors in NGOs (10%). Low–middle income countries were likely to never or rarely report transferring and translating knowledge to directors in donor agencies (52.3%) and directors in a health professional association or group (21.5%). Approximately two-thirds of respondent institutions reported that their researchers had the skills to disseminate research findings to policy-makers in government (62.8%), and directors of NGOs (74.9%) (Table 4).

Research impact

Only 26.5% of respondent institutions reported that they frequently/always examine the extent to which health policy-makers utilize the institution’s health research results. Moreover, only 23.3% measure the impact of their health research outcomes (Table 5). More than half of responding institutions (55.3%) reported believing that health research produced by their institution has impacted health policymaking. Some reported methods for impact assessment included feedback from stakeholders, article citation, implementation of research recommendations, and changes in health policy, among others.

Discussion

This mapping exercise provides an overview of the engagement of institutions undertaking health research in the EMR in KT activities. The study showed that many EMR countries might be lacking a national strategy for health research, since almost half of respondents reported not having or not knowing whether their countries have national health research priorities. This finding concurs with another mapping exercise conducted in the Region, which showed that three out of 10 countries surveyed reported setting national health research priorities, while only two countries had a dedicated national health research policy (10).

Findings highlight misalignment between national health research priorities and actual research production, since the majority of respondents indicated submitting proposals not addressing national health research priorities. This corroborates findings of previous studies conducted in the Region that highlighted a gap in the production of policy-relevant research (5,16,17). This can be explained by the fact that only 31.7% of the surveyed institutions reported being involved in a national priority setting exercise over the past five years. A survey of researchers in the EMR has also found that less than half of researchers (16%) interacted with policy-makers and stakeholders in priority setting (5). Even when institutions reported conducting priority-setting exercises, 60.2% reported not following a standardized methodology, while the remainder provided no details on the exact methodology. There was no significant difference according to organization type, sector or country income level with regard to whether or not such an exercise was conducted. However, involving policy-makers and stakeholders in setting priorities for research on health was highest among NGOs. Conducting priority setting is only the first step in KT and should be followed by evidence synthesis, development of KT products and impact assessment (18).

Around half of respondents did not know whether a national health council that regulates funding priorities exists in their country. Findings also suggest that funders occasionally and rarely formulate their priorities and calls for proposals in response to national/regional needs, which can partially explain the misalignment. Respondents mostly reported NCDs as their top priority, which corresponds to regional and global priorities as declared by stakeholders, policy-makers and regional and international organizations (17,19–21).

Our findings suggest that KT activities including policy briefs, policy dialogues and letters/briefs tailored to policy-makers are still rarely undertaken by institutions in the EMR. This supports findings of a previous survey of researchers in the EMR (5). Another survey conducted in 2008 in 10 countries in the EMR also found that none of those countries reported systematic efforts to feed research results into decision-making (10). Indeed, only 26.5% of the institutions surveyed in this study reported frequently/always examining the extent to which health policy-makers utilize their health research results, and only 23.3% measure the impact of their health research outcomes. Policy briefs and similar KT products are important tools for topics that are highly politicized and where the nature of the problem is contentious and lacks clarity (22). As such, there is a need for capacity development to create such tools and evaluation of their effectiveness in the context of the EMR.

It was interesting to observe that institutions in high-income EMR countries were least likely to transfer/translate knowledge to policy-makers and directors in NGOs. In addition, they were most likely to report submitting proposals not addressing national health research priorities and not knowing whether a national health council that regulates funding priorities existed in their countries, compared to other income level countries. These findings can be interpreted by the minimal representation of major research institutions from high-income EMR countries.

Implications for research and policy

National governments and international funding agencies are called to support research production and translation through increasing the funding allocated to health research and knowledge translation, and through investing and supporting capacity building activities in KT in the Region. Recently, WHO/EMRO has supported capacity building activities in this regard, including holding a regional training of trainers policy briefs development workshop carried out during Sept 2016 (23), followed by national exercises carried out in the Islamic Republic of Iran, which are also planned for Egypt, Saudi Arabia and Sudan. In addition, the Knowledge to Policy (K2P) Center at the American University of Beirut, Lebanon, has been designated as a WHO-Collaborating Center for Evidence Informed Policy and Practice during the period 2016–2019 to support this agenda (24). K2P is supporting WHO/EMRO through conducting priority-setting exercises to identify policy relevant priorities. The Center is also building capacity in evidence synthesis, producing knowledge translation documents, and guidance documents.

Institutions and researchers can also work to produce policy-relevant research and engage policy-makers in regular national priority-setting exercises. There is also a need for a standardized methodology for a priority-setting and impact assessment. A measure of the impact of research on policy can motivate institutions and researchers to engage in KT and for funders to support such KT activities.

Acknowledgements

This survey and related research work was supported by the WHO Regional Office for the Eastern Mediterranean. Completion of this project would not have been possible without the continuous support and encouragement of Dr Ala Alwan, former Regional Director; Dr Mahmoud Fikri, late Regional Director; Dr Jaouad Mahjour, Former Director of Programme Management, and Dr Arash Rashidian, Director, Information, Evidence and Research Department. The following experts supported country-specific databases and encouraged response of participating health research institutions: Dr Najibullah Safi, Afghanistan; Dr Randah Hamadeh, Bahrain; Dr Sherine Shawky, Egypt; Dr Reza Majdzadeh, Islamic Republic of Iran; Dr Nada Alwan, Iraq; Dr Raeda Abu Al Rub, Jordan; Dr Hanan Badr, Kuwait; Dr Salim Adib, Lebanon; Dr Azza Greiw, Libya; Dr Asma El Alami Felousse, Morocco; Dr Adhra Al Mawali, Oman; Dr Assad Hafeez and Dr Saima Hamid, Pakistan; Dr Niveen Abu Rmeileh, Palestine; Dr Ziad Mahfoud, Qatar; Dr Haifa Wahabi, Saudi Arabia; Dr Samira Abdel Rahman, Sudan; Dr Hyam Bashour, Syrian Arab Republic; Dr Chokri Arafa, Tunisia; Dr Ghada Al Tajir, United Arab Emirates, and Dr Ali Assabri, Yemen.

Funding: None.

Competing interests: None declared.

Engagement des établissements de recherche en santé en faveur de l’application du savoir dans la Région de la Méditerranée orientale

Résumé

Contexte : Les établissements de recherche en santé de la Région de la Méditerranée orientale peuvent jouer un rôle prépondérant dans la promotion de l’application du savoir et le soutien apporté à cet égard. Il importe d’évaluer l’engagement des établissements en faveur de l’application du savoir et de combler le décalage entre les recherches et les politiques pour l’élaboration de stratégies adaptées au contexte qui permettent de faire la promotion de l’application du savoir, ainsi que pour l’orientation des efforts de financement dans la Région.

Objectifs : L’objectif de la présente étude était d’examiner l’engagement des établissements de la Région de la Méditerranée orientale dans les activités liées à l’application du savoir.

Méthodes : Une étude transversale a été réalisée auprès d’établissements faisant de la recherche en santé dans les 22 pays de la Région de la Méditerranée orientale. L’étude couvrait les aspects institutionnels, la planification institutionnelle de la recherche, la planification nationale de la recherche en santé, ainsi que la gestion des connaissances, leur application et leur diffusion.

Résultats : Sur 575 établissements contactés, 223 (38,3 %) ont répondu. La moitié des établissements étudiés ont rapporté avoir réalisé des exercices d’établissement des priorités, 60,2 % de ces établissements ne suivant pas une approche standardisée. Moins de la moitié des établissements ont indiqué qu’ils impliquaient fréquemment/toujours (40,5 %) les responsables politiques et les parties prenantes dans l’établissement des priorités en matière de recherche en santé. Seulement 26,5 % des établissements ayant répondu ont mentionné qu’ils cherchaient à savoir dans quelle mesure les responsables politiques en santé utilisaient leurs résultats de recherche. De plus, seulement 23,3 % ont déclaré mesurer l’impact de leur recherche en santé.

Conclusion : Il existe toujours un décalage entre les priorités de recherche en santé nationales et les travaux de recherche produits concrètement, et les établissements de la Région de la Méditerranée orientale continuent de ne mener des activités liées à l’application du savoir qu’en de rares occasions. Les gouvernements des pays et les bailleurs de fonds internationaux sont appelés à soutenir la production et l’application de la recherche dans la Région. Les établissements et les chercheurs sont également incités à générer une recherche utile à la politique, ainsi qu’à répondre aux besoins et aux priorités des responsables de l’élaboration des politiques.

مشاركة مؤسسات البحوث الصحية في الترجمة التطبيقية للمعارف في إقليم شرق المتوسط

فادي الجردلي، أحمد منديل، ديانا جمال، لما بوكروم، سمر الفقي، محمد نور، مازن العبار

الخلاصة

الخلفية: يمكن للمؤسسات المعنية بالبحوث الصحية في إقليم شرق المتوسط أن تلعب دوراً أساسياً في تعزيز ودعم الترجمة التطبيقية للمعارف (أي وضع المعرفة البحثية موضع التطبيق). ويُعَدُّ تقييم مشاركة المؤسسات في الترجمة التطبيقية للمعارف وسد الفجوة بين «البحوث - والسياسات» أمراً هاماً في تصميم استراتيجيات محددة السياق لتعزيز وضع المعارف موضع التطبيق وتوجيه جهود التمويل المبذولة في الإقليم.

الأهداف: الهدف من هذه الدراسة هو استكشاف مشاركة مؤسسات إقليم شرق المتوسط في أنشطة الترجمة التطبيقية للمعارف.

طرق البحث: مسح مستعرض للمؤسسات التي تجري بحوثاً صحية في 22 بلداً من بلدان إقليم شرق المتوسط. وقد غطّى المسح الخصائص المؤسسية، والتخطيط المؤسسي للبحوث، والتخطيط الوطني للبحوث الصحية، وإدارة المعارف، والترجمة والنشر.

النتائج: جرى الاتصال على 575 مؤسسة واستجابت 233 مؤسسة منها (38.3%). وأفادت نصف المؤسسات التي شملتها العينة بأنها تجري عمليات لتحديد الأولويات، حيث لم يتبع 60.2% منها منهجاً معياريًا. وأفاد أقل من نصف المؤسسات (40.5%) بأنها تشرك صناع السياسات وأصحاب المصلحة في كثير من الأحيان أو دائماً في تحديد أولويات بحوثها الصحية. وأفادت 26.5% فقط من المؤسسات المستجيبة أنها تدرس مدى استفادة صانعي السياسات الصحية من نتائج بحوثهم. علاوة على ذلك، أفاد 23.3% فقط من المشاركين بأنهم يقيسون تأثير بحوثهم الصحية.

الاستنتاجات: لا تزال هناك اختلالات بين الأولويات البحثية الصحية الوطنية، ونادراً ما تضطلع المؤسسات البحثية في إقليم شرق المتوسط بالإنتاج الفعلي للبحوث وأنشطة الترجمة التطبيقية للمعارف. وإن الحكومات الوطنية ووكالات التمويل الدولية مدعوة لدعم إنتاج البحوث والترجمة التطبيقية لها في إقليم شرق المتوسط. وكذلك المؤسسات والباحثون مدعوون إلى إنتاج بحوث ذات صلة بالسياسات والاستجابة لاحتياجات واضعي السياسات وأولوياتهم.

References

  1. Gonzalez Block MA, Mills A. Assessing capacity for health policy and systems research in low and middle income countries. Health Res Policy Syst. 2003 01 13;1(1):1. https://doi.org/10.1186/1478-4505-1-1 PMID:12646072
  2. Statement V for the Fourth Global Symposium on Health Systems Research Vancouver. Canada, 18 November 2016 (http://healthsystemsresearch.org/hsr2016/wp-content/uploads/Vancouver-Statement-FINAL.pdf, accessed 26 May 2017).
  3. World Health Organization. The World Health Report 2013: Research for Universal Health Coverage. Geneva: World Health Organization; 2013 (http://apps.who.int/iris/bitstream/10665/85761/2/9789240690837_eng.pdf?ua=1).
  4. Canadian Institutes of Health Research (CIHR). Knowledge translation & commercialization. Ottawa: CIHR; 2017 (http://www.cihr-irsc.gc.ca/e/29529.html, accessed May 22 2017).
  5. El-Jardali F, Lavis JN, Ataya N, Jamal D. Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers. Implement Sci. 2012 01 11;7(1):2. https://doi.org/10.1186/1748-5908-7-2 PMID:22236561
  6. El-Jardali F, Lavis JN, Ataya N, Jamal D, Ammar W, Raouf S. Use of health systems evidence by policymakers in eastern Mediterranean countries: views, practices, and contextual influences. BMC Health Serv Res. 2012 07 16;12(1):200. https://doi.org/10.1186/1472-6963-12-200 PMID:22799440
  7. Gholami J, Ahghari S, Motevalian A, Yousefinejad V, Moradi G, Keshtkar A, et al. Knowledge translation in Iranian universities: need for serious interventions. Health Res Policy Syst. 2013 11 13;11(1):43. https://doi.org/10.1186/1478-4505-11-43 PMID:24225146
  8. Tugwell P, Sitthi-Amorn C, Hatcher-Roberts J, Neufeld V, Makara P, Munoz F, et al. Health Research Profile to assess the capacity of low and middle income countries for equity-oriented research. BMC Public Health. 2006 06 12;6(1):151. https://doi.org/10.1186/1471-2458-6-151 PMID:16768792
  9. Ismail SA, McDonald A, Dubois E, Aljohani FG, Coutts AP, Majeed A, et al. Assessing the state of health research in the Eastern Mediterranean Region. J R Soc Med. 2013 Jun;106(6):224–33. https://doi.org/10.1258/jrsm.2012.120240 PMID:23761582
  10. Kennedy A, Khoja TA, Abou-Zeid AH, Ghannem H, IJsselmuiden C; WHO-EMRO/COHRED/GCC NHRS Collaborative Group. National health research system mapping in 10 Eastern Mediterranean countries. East Mediterr Health J. 2008 May-Jun;14(3):502–17. PMID:18720615
  11. World Health Organization Regional Office for the Eastern Mediterranean (WHO/EMRO). National health research system mapping in the Eastern Mediterranean Region. A study of ten countries. Cairo: WHO/EMRO; 2008.
  12. Dobrow MJ, Costa S, Israr S, Chafe R. Mapping health services and policy research settings in Canada: following the money, the publications and the interest. Healthc Policy. 2010 Nov;6(2):84–98. PMID:22043225
  13. Lavis JN, Guindon GE, Cameron D, Boupha B, Dejman M, Osei EJ, Sadana R, Research to Policy and Practice Study Team: Bridging the gaps between research, policy and practice in low- and middle-income countries: a survey of researchers. CMAJ 2010, 182:E350-E36 1. https://doi.org/10.1503/cmaj.081164.
  14. Gholami J, Majdzadeh R, Nedjat S, Nedjat S, Maleki K, Ashoorkhani M, et al. How should we assess knowledge translation in research organizations; designing a knowledge translation self-assessment tool for research institutes (SATORI). Health Res Policy Syst. 2011 02 22;9(1):10. https://doi.org/10.1186/1478-4505-9-10 PMID:21342517
  15. Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L. Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy. 2009 08 24;6(1):21. https://doi.org/10.1186/1743-8462-6-21 PMID:19698186
  16. El-Jardali F, Bou-Karroum L, Hemadi N, Jammal A. Evidence Gap Map of Health Policy and Systems Research in 15 countries of the Eastern Mediterranean Region: Working Paper. MENA Health Policy Forum. Cairo, Egypt, June 2015.
  17. El-Jardali F, Saleh S, Khodor R, Abu Al Rub R, Arfa C, Ben Romdhane H, et al. An institutional approach to support the conduct and use of health policy and systems research: The Nodal Institute in the Eastern Mediterranean Region. Health Res Policy Syst. 2015 10 1;13(1):40. https://doi.org/10.1186/s12961-015-0032-9 PMID:26428084
  18. Akl EA, Fadlallah R, Ghandour L, Kdouh O, Langlois E, Lavis JN, et al. The SPARK Tool to prioritise questions for systematic reviews in health policy and systems research: development and initial validation. Health Res Policy Syst. 2017 09 4;15(1):77. https://doi.org/10.1186/s12961-017-0242-4 PMID:28870215
  19. Alwan A. Responding to priority health challenges in the Arab world. Lancet. 2014 Jan 25;383(9914):284–6. https://doi.org/10.1016/S0140-6736(13)62572-6 PMID:24452039
  20. General Assembly of the United Nations. High-level meeting on Non-Communicable diseases. United Nations: New York; 2011 (http://www.un.org/en/ga/president/65/issues/ncdiseases.shtml).
  21. World Health Organization WHO (2013). Global action plan for the prevention and control of noncommunicable diseases 2013-2020. Geneva: World Health Organization; 2013.
  22. Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009 12 16;7 Suppl 1:S13. https://doi.org/10.1186/1478-4505-7-S1-S13 PMID:20018103
  23. World Health Organization Regional Office for the Eastern Mediterranean WHO EMRO. Training of trainers workshop on capacity-building in development of policy briefs (http://www.emro.who.int/rpc/rpc-news/training-of-trainers-workshop-on-capacity-building-in-development-of-policy-briefs.html).
  24. Knowledge to Policy (K2P) Center. Beirut: American University of Beirut; 2017 (http://website.aub.edu.lb/k2p/Pages/index.aspx, accessed 24 November 2017).