Eastern Mediterranean Health Journal | All issues | Volume 26 2020 | Volume 26 issue 3 | Reuse of syringes for therapeutic injections in Pakistan: rethinking determinants

Reuse of syringes for therapeutic injections in Pakistan: rethinking determinants

Print PDF

PDF version

Adnan Khan,1 Arshad Altaf,3 Huma Qureshi,2 Mejzgaan Orakzai 1 and Ayesha Khan 4

1Research and Development Solutions, Islamabad, Pakistan (Correspondence to: A.A. Khan: This e-mail address is being protected from spambots. You need JavaScript enabled to view it ). 2Pakistan Health Research Council, Islamabad, Pakistan. 3Service Delivery and Safety Department, World Health Organization, Geneva, Switzerland. 4Akhter Hameed Khan Resource Center, Islamabad, Pakistan.

Abstract

Background: Frequent reuse of syringes during medical injections is fuelling epidemics of human immunodeficiency virus and hepatitis C virus infections in many low- and middle-income countries including Pakistan.

Aims: To explore specific factors related to syringe reuse during therapeutic injections.

Methods: We randomly surveyed 319 healthcare providers from 2 socioeconomically diverse districts in Pakistan, along with 625 of their patients.

Results: Providers see 12–25 patients per day, and provide 7–14 therapeutic injections or intravenous drips. Comparing daily stocks with injections provided, we estimated that 38% of providers (Rawalpindi: 14%, Tando Allah Yar: 44%) likely reuse syringes 2 or 3 times. Rural location and longer duration of practice predict a higher likelihood of reuse. Physicians and non-physicians were equally likely to reuse. Most patients were unaware when a syringe had been reused.

Conclusions: High rate of syringe reuse is driven by high injection demand by patients, to which providers comply. Patients are generally unaware of the harm of injections with syringe reuse or that reuse happens. Our findings suggest that patient focused approaches may help reduce syringe reuse.

Keywords: injection demand, injection safety, syringe reuse, therapeutic injections, unsafe injections

Citation: Khan AA; Altaf A; Qureshi H; Orakzai M; Khan A. Reuse of syringes for therapeutic injections in Pakistan: rethinking its definition and determinants. East Mediterr Health J. 2020;26(3):280–286. https://doi.org/10.26719/emhj.19.028

Received: 31/08/17; accepted: 28/06/18

Copyright © World Health Organization (WHO) 2020. Open Access. Some rights reserved. This work is available under the CC BY-NC-SA 3.0 IGO license (https://creativecommons.org/licenses/by-nc-sa/3.0/).


Introduction

Syringe reuse during therapeutic injections has contributed to the global epidemics of hepatitis C virus (1,2) and human immunodeficiency virus (HIV) (3–6) infection, and is well documented in high-income (7,8) and low- and middle-income countries (9–11). In Pakistan, high reuse of syringes during therapeutic injections (13) has led to a national prevalence of hepatitis C of 4.8% (12), with some districts as high as 12%, and has contributed to at least one community outbreak of HIV infection (14). Therapeutic injections in Pakistan range from 4.2–4.6 injections per person annually (13), with 17–50% of these injections being given with reused syringes (12,13,15,16). Currently, conventional disposable syringes are used in Pakistan. The Punjab Government introduced reuse-prevention (RUP) syringes in its health facilities in 2017 (17). The World Health Organization’s injection safety guidelines recommend RUP for all injections and sharp-injury protection syringes, wherever feasible (18).

We have previously demonstrated that the total national supply of syringes in Pakistan is sufficient to meet the demand for the ~1.1 billion syringes used annually for immunization, diabetes, laboratory testing and drug administration in clinics or hospitals (13). Therefore reuse of syringes cannot be attributed merely to a national shortfall of syringes as had been previously thought. However, such national aggregates hide reuse by individual practitioners. The present study explored the extent and pattern of syringe reuse in Pakistan. We also explored a novel method to identify reuse to avoid providers’ self-promotion and patients’ recall biases, as well as paradigms behind injection demand and supply in communities.

Methods

Rawalpindi and Tando Allah Yar were identified in collaboration with the Pakistani Ministry of Health as districts exemplifying high and low human development indices (19), to understand injection reuse practices across the extremes of human development. Rawalpindi is a large metropolis with a large number of public and private, and primary, secondary and tertiary medical care centres and specialists. Although around half of the population of Rawalpindi District is rural, the villages are close to the city. Tando Allah Yar is completely rural and poor. Data were collected between February and April 2009.

In the first phase, all healthcare providers from all 19 Union Councils of Tando Allah Yar and 38 (1: 5) randomly selected Union Councils from Rawalpindi were listed. Thus, 6053 providers were identified as any individuals who see patients in communities, irrespective of their training or licensure. This list was used to construct a simple randomization–sampling frame to recruit healthcare providers. The study was powered for type I error (α): 0.05 and type II error (β): 0.2; giving a total of 320 providers to be divided between districts (Epi Info). The relative number of the providers between districts was weighted for the providers per Union Councils included in the listing, giving 174 providers from Rawalpindi and 145 from Tando Allah Yar. At each healthcare provider’s facility, 2 patients were approached to participate in a brief survey, from among those present at the time of study team visit and based on who was encountered first.

Provider and patient questionnaires were pretested to ensure validity and appropriateness. The providers’ questionnaire asked about their training and practice pattern. The patients’ questionnaire asked about their demographics and healthcare-seeking behaviour. Both were asked about knowledge about syringe reuse and its harm.

Reuse of injections was identified by 3 measures: (1) the study teams observed providers while managing patients, including while giving injections; (2) recognizing that such observations may be subject to a Hawthorne effect (20,21), where providers’ behaviour may change when they recognize that they are being observed, we also asked patients if they felt that the injection they received was given with a new or reused syringe; and (3) since many patients may not have known whether a syringe was reused, we also used a proxy measure. We asked providers how many syringes they stocked for the previous day and compared these against the number of injections they said they had provided yesterday. This difference identified providers that were sure to reuse syringes since they would have insufficient syringes for all the injections they gave. This established a minimum level of reuse since providers can potentially reuse even when they have insufficient syringes. Recall bias was limited by asking only about the previous day. Variables were compared using SPSS+ version 20. Proportions of those that gave injections, and reusers were compared using χ2 tests. Predictors of reuse of syringes were explored using linear regression with predictors described in Table 5. These factors included all that were considered relevant to syringe reuse.

The study was reviewed and approved by the Ethical Review Committee of Bridge Consultants Foundation, Karachi, Pakistan. Informed consent was obtained from all participants.

Results

We interviewed 319 providers (145 from Tando Allah Yar and 174 from Rawalpindi). Their mean (standard deviation) age was 44.5 (11.8) years in Rawalpindi and 39.6 (10.2) years in Tando Allah Yar, and there were 265 (83%) men. Around half (57%) of all providers from Rawalpindi and 26% from Tando Allah Yar were physicians, with more urban than rural providers being physicians (Table 1). Urban providers from Rawalpindi saw a mean 27.5 patients a day and their rural counterparts saw a mean 16.7. Rural and urban providers from Tando Allah Yar saw a mean 19.9 and 21.8 patients a day respectively.

We interviewed 625 patients (273 from Tando Allah Yar and 352 from Rawalpindi). Their mean age was 34.4 (18.7) years in Rawalpindi and 32.2 (12.1) years in Tando Allah Yar; 603 (56%) were men (Table 2). Twenty percent of patients from Rawalpindi had no schooling, compared with 56% from Tando Allah Yar. Patients from Tando Allah Yar were more likely to be farmers, labourers or housewives, while those from Rawalpindi were mostly skilled labourers, housewives, office workers or students

Commonest reasons for medical visits were fever, influenza-like symptoms or body aches (51% of all patient visits) or abdominal symptoms such as pain, vomiting or diarrhoea (11% of visits). An injection was provided during 53% of patient visits in Rawalpindi and 92% in Tando Allah Yar (Table 2). Patients from Rawalpindi reported having received a mean of 5.4 injections during the previous year compared to 13.2 injections by patients from Tando Allah Yar.

Patients from Tando Allah Yar reported a mean 3.8 visits to a healthcare provider by a member of their household during the previous month, compared to 2.5 by those from Rawalpindi (Table 2). During all such visits, an injection was given. Overall, 56% patients felt that an injection was necessary. Such perceptions were higher in Tando Allah Yar than in Rawalpindi (79% vs. 39%) (Table 2). Providers reciprocated such perceptions in that 44–56% of providers felt that an injection was required for common ailments such as fever, influenza, body aches or diarrhoea (Table 4). In practice, it was highly likely that an injection would be given for fever (OR: 7.9, P = 0.022) but not for abdominal pain/ diarrhoea (OR 5.4, P = 0.187).

Providers from Rawalpindi charged a mean US$ 1.44 for a visit when no injection was given and US$ 1.51 if an injection was given; there were no rural/urban differences. Providers from Tando Allah Yar charged a mean US$ 0.59 when an injection was provided and US$ 0.62 when not provided. Providers charged a mean US$ 0.56 in rural and US$ 0.69 in urban locations. Providers from Rawalpindi reported giving a mean of 8.8 intramuscular injections, 3.5 intravenous injections and 2.3 intravenous drip daily (Table 3). Providers from Tando Allah Yar gave a mean 10.0 intramuscular injections, 3.9 intravenous injections and 1.4 intravenous drip daily. We asked providers how many syringes they had stocked for the day: 140 (48%) providers from Rawalpindi and 122 (46%) from Tando Allah Yar gave more injections than their daily stock of syringes. Therefore, they would have been likely to reuse syringes regularly. For analysis, these were labelled as likely reusers. No urban provider from Rawalpindi fell into this category, while urban and rural providers in Tando Allah Yar were similar (Table 3). Around 38% of all providers were likely to reuse consistently (Table 4). These likely reusers gave a mean 14.4 injections daily compared to 12.3 by those who were less likely to reuse syringes. Since reusers stocked around 5 syringes a day, they would likely have reused syringes for 9 injections in any given day.

Of the variables used in the linear regression model (Table 5), only practicing in Tando Allah Yar (AOR 1.92, range 1.9–7.69) and a longer duration of practice (AOR 0.6% for each year in practice, range 0.1–1%) increased the likelihood for reuse. Physicians were just as likely to reuse as non-physicians. Our teams observed patient encounters for any injection reuse and we also asked patients if they had observed syringe reuse. Both of these modes of inquiry identified reuse during < 5% of observations/visits. Nearly all providers, but few patients, were aware of the possibility of acquiring injection site injuries or infections such as hepatitis or HIV infection from reused syringes.

Discussion

We found that around half of the patients had received an injection during their current visit and that at least 38% of the providers were likely to reuse syringes during injections. Reuse happens just as often by physicians or non-physicians and is irrespective of sex of providers or the fee charged. Both providers and patients felt that injections were necessary for common ailments.

The high injection demand and provision seen in our study were consistent with prior experience from Pakistan (22) or the surrounding region (13,23–27). Patients expect to receive injections for minor ailments such as fever or influenza-like symptoms and willingly pay for these, on the mistaken belief in the efficacy of injections to overcome common symptoms that eventually abate with time (10). Healthcare providers comply with such wishes and are convinced of the necessity of injections. This belief is common among providers irrespective of whether they are likely or not to reuse syringes.

Syringe reuse happens against a backdrop of frequent injections. Around 38% of injection providers procure too few syringes for the injections that they provide and will likely reuse consistently. They also see more patients and give more injections. They charge slightly less per visit than providers that do not reuse syringes; however, their fees remain largely the same whether or not they give an injection. These providers stock a median of 5 syringes and give 14 injections daily; meaning that each syringe is reused 2 or 3 times. Providers’ knowledge of the potential harm of syringe reuse and their incentives to reuse also mean that approaches such as information provision or availability of autodisposable syringes will not work, unless these are the only type of syringes available. Additionally, simply demanding or making laws against reuse are not likely to succeed. However, since providers’ savings from syringe reuse are hidden from the patients, there may be a potential role for a patient-focused approach by which patients are made more aware of syringe reuse and its harm (18).

Community approaches that reduce information asymmetry between providers and patients have been promising (28). One intervention in Tando Allah Yar improved patient awareness from 15% to 29% within 6 months (29). Other complementary approaches may be to brand as safe providers those that visibly do not reuse syringes. Another option would be to use positive deviance inquiry in communities to reduce injection demand and syringe reuse (30–32).

One limitation of our study was that because we compared the supply of syringes versus injections given, we could only estimate the minimum reuse by providers. In reality, a provider may reuse more often, although perhaps not by much, because they would then adjust their syringe procurement accordingly in the long run.

Conclusion

Our study highlights the high prevalence of syringe reuse during therapeutic injections in communities in Pakistan and suggests that patient-centred approaches (demand reduction and increased awareness of the harm of syringe reuse), but probably not provider-centred approaches, may help reduce syringe reuse. New research should explore why patients seek such unnecessary care and test behavioural approaches such as cognitive behavioural therapy, expectation management, or whether patients will pay for safe injections, to make medical practice and injections safer in poor communities.

Funding: None.

Competing interests: None declared.

Réutilisation des seringues pour injections thérapeutiques au Pakistan : réflexion sur ses déterminants

Résumé

Contexte : La réutilisation fréquente des seringues lors des injections thérapeutiques alimente des épidémies d’infections par les virus de l’immunodéficience humaine et de l’hépatite C dans de nombreux pays à revenu faible et intermédiaire, y compris le Pakistan.

Objectifs : Étudier les facteurs spécifiques liés à la réutilisation des seringues lors des injections thérapeutiques.

Méthodes : Nous avons interrogé 319 prestataires de soins, de façon aléatoire, dans deux districts du Pakistan présentant une diversité socio-économique, ainsi que 625 de leurs patients.

Résultats : Les prestataires voient de 12 à 25 patients et effectuent de 7 à 14 injections thérapeutiques ou perfusions intraveineuses goutte-à-goutte par jour. En comparant les stocks journaliers avec les injections réalisées, nous avons estimé que 38 % des prestataires (Rawalpindi : 14 %, Tando Allah Yar : 44 %) réutilisent vraisemblablement les seringues deux ou trois fois. L’implantation rurale et l’ancienneté d’exercice laissent anticiper une plus grande probabilité de réutilisation. Les médecins et les autres membres du personnel soignant étaient aussi susceptibles de réutiliser les seringues. Lorsqu’une seringue était réutilisée, la plupart des patients n’en avaient pas conscience.

Conclusions : Le taux élevé de réutilisation des seringues est induit par une forte demande d’injections par les patients, à laquelle répondent les prestataires de soins. En général, les patients n’ont pas conscience de la dangerosité des injections effectuées avec des seringues réutilisées, ni même de la pratique de réutilisation. Les résultats de notre enquête indiquent que des approches centrées sur le patient pourraient aider à réduire la réutilisation des seringues.

إعادة استعمال المحاقن للحَقْن العِلاَجِيّ في باكستان: إعادة النظر في استعمال المحاقن ومحدداته

عدنان خان، أرشد ألطف، هوما قرشي، مزدجان أركازي، عايشة خان

الخلاصة

الخلفية: إن إعادة استعمال المحاقن تَكراراً من شأنه أن يؤجج الأوبئة المرتبطة بفيروس العوز المناعي البشري‬ والعدوى بفيرو س التهاب الكبد C في كثير من البلدان المنخفضة الدخل والمتوسطة الدخل، ومنها باكستان.

الأهداف: هدفت الدراسة إلى استكشاف العوامل المُحددة المرتبطة بإعادة استعمال المحاقن للحَقْن العِلاجِيّ

طرق البحث: أجرينا مسحاً عشوائياً شمل 319 مرفقاً من مرافق تقديم خدمات الرعاية الصحية من منطقتين بينهما تبايُن من الناحية الاجتماعية والاقتصادية في باكستان، بالإضافة إلى 625 مريضاً ممن يرتادون هذه المرافق.

النتائج: يفحص مقدمو الخدمة ما يتراوح بين 12-25 مريضاً يومياً، ويعطون الحقن العلاجي أو التقطير داخل الوريد لما يتراوح ما بين 7-14 مريضاً. وبمقارنة المخزون اليومي بعمليات الحقن التي تحدث، قدرنا أنه في 38% من مقدمي خدمات الرعاية الصحية (روالبندي: 14%، تاندو الله يار: 44%) يُرجح إعادة استعمال المحاقن بمقدار مرتين أو 3 مرات. ويُرجح بنسبة أعلى إعادة استعمال المحاقن في المناطق الريفية وأثناء الممارسات الطبية التي تستغرق وقتاً أطول. ويتساوى الأطباء وغير الأطباء في احتمال إعادتهم استعمال المحاقن. وأفاد معظم المرضى بأنهم لا يكونون على دراية بأن المِحْقَنَة المُستعملة في الحقن مُعاد استعمالها.

الاستنتاجات: يرجع ارتفاع معدل إعادة استعمال المحاقن إلى ارتفاع الطلب على المحاقن من جانب المرضى، وتلبية مقدمي خدمات الرعاية الصحية لهذا الطلب. وعامةً، لا يكون المرضى مُدركين لضرر الحقن عن طريق إعادة استعمال المِحْقَنَة، أو ربما لا يكونون مدركين في الأساس أن المحاقن يُعاد استعمالها. ووفقاً للنتائج التي توصلنا إليها، نرى أن النهوج التي تركز على المرضى قد تساعد في الحد من إعادة استعمال المحاقن.

References

  1. Brewer DD, Khan AA. HCV and HIV prevalences strongly correlated in Asian communities with reservoirs of HIV in high-risk groups. J Infect Dev Ctries. 2010 Aug 4;4(7):442–7. PMID:20818092
  2. Shepard CW, Finelli L, Alter MJ. Global epidemiology of hepatitis C virus infection. Lancet Infect Dis. 2005 Sep;5(9):558–67. http://dx.doi.org/10.1016/S1473-3099(05)70216-4 PMID:16122679
  3. Reid S, Van Niekerk AA. Injection risks and HIV transmission in the Republic of South Africa. Int J STD AIDS. 2009 Dec;20(12):816–9. http://dx.doi.org/10.1258/ijsa.2009.009230 PMID:19948894
  4. Brewer DD, Gisselquist D, Brody S, Potterat JJ. Investigating iatrogenic HIV transmission in Ugandan children. J Acquir Immune Defic Syndr. 2007 Jun 1;45(2):253–4. http://dx.doi.org/10.1097/QAI.0b013e31805d8af9 PMID:17527097
  5. Potterat JJ, Brewer DD, Brody S. Miscarriage of HIV epidemiology in sub-Saharan Africa. AIDS. 2006 Apr 4;20(6):955–6. http://dx.doi.org/10.1097/01.aids.0000218571.35768.ce PMID:16549991
  6. Brody S, Gisselquist D, Potterat JJ, Drucker E. Evidence of iatrogenic HIV transmission in children in South Africa. BJOG. 2003 May;110(5):450–2. PMID: 1274232
  7. Comstock RD, Mallonee S, Fox JL, Moolenaar RL, Vogt TM, Perz JF, et al. A large nosocomial outbreak of hepatitis C and hepatitis B among patients receiving pain remediation treatments. Infect Control Hosp Epidemiol. 2004 Jul;25(7):576–83. http://dx.doi.org/10.1086/502442 PMID:15301030
  8. Fischer GE, Schaefer MK, Labus BJ, Sands L, Rowley P, Azzam IA, et al. Hepatitis C virus infections from unsafe injection practices at an endoscopy clinic in Las Vegas, Nevada, 2007–2008. Clin Infect Dis. 2010 Aug 1;51(3):267–73. http://dx.doi.org/10.1086/653937 PMID:20575663
  9. Simonsen L, Kane A, Lloyd J, Zaffran M, Kane M. Unsafe injections in the developing world and transmission of bloodborne pathogens: a review. Bull World Health Organ. 1999;77(10):789–800. PMID:10593026
  10. Kermode M. Unsafe injections in low-income country health settings: need for injection safety promotion to prevent the spread of blood-borne viruses. Health Promot.Int. 2004 Mar;19(1):95–103. http://dx.doi.org/10.1093/heapro/dah110 PMID:14976177
  11. Miller MA, Pisani E. The cost of unsafe injections. Bull World Health Organ. 1999;77(10):808–11. PMID:10593028
  12. Qureshi H, Bile KM, Jooma R, Alam SE, Afridi HU. Prevalence of hepatitis B and C viral infections in Pakistan: findings of a national survey appealing for effective prevention and control measures. East Mediterr Health J. 2010;16 Suppl:S15–23. PMID: 2149558
  13. Khan AA, Saleem M, Qureshi H, Jooma R, Khan A. Comparison of need and supply of syringes for therapeutic injections in Pakistan. J Pak Med Assoc. Nov 2012 Nov;62(11):1149–53. PMID:23866401
  14. Ansari JA, Salman M, Safdar RM, Ikram N, Mahmood T, Zaheer HA, et al. HIV/AIDS outbreak investigation in Jalalpur Jattan (JPJ), Gujrat, Pakistan. J Epidemiol Glob Health. 2013 Dec;3(4):261–8. http://dx.doi.org/10.1016/j.jegh.2013.06.001 PMID:24206797
  15. Khan AJ, Luby SP, Fikree F, Karim A, Obaid S, Dellawala S, et al. Unsafe injections and the transmission of hepatitis B and C in a periurban community in Pakistan. Bull World Health Organ. 2000 2000;78(8):956–63. PMID:10994278
  16. Hutin YJ, Hauri AM, Armstrong GL. Use of injections in healthcare settings worldwide, 2000: literature review and regional estimates. BMJ. 2003 Nov 8;327(7423):1075. http://dx.doi.org/10.1136/bmj.327.7423.1075 PMID:14604927
  17. Plan to introduce auto destructive syringes. Dawn. 17 November 2016 (https://www.dawn.com/news/1296822/plan-to-introduce-auto-destructive-syringes, accessed 15 May 2019).
  18. WHO guideline on the use of safety-engineered syringes for intramuscular, intradermal and subcutaneous injections in health care settings. Geneva: World Health Organization; 2016 (http://apps.who.int/iris/bitstream/10665/250144/1/9789241549820-eng.pdf, accessed 1 October 2019).
  19. List of districts of Pakistan by Human Development Index (https://en.wikipedia.org/wiki/List_of_districts_of_Pakistan_by_Human_Development_Index, accessed 15 May 2019).
  20. McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol. 2014 Mar;67(3):267–77. http://dx.doi.org/10.1016/j.jclinepi.2013.08.015 PMID:24275499
  21. McCarney R, Warner J, Iliffe S, van Haselen R, Griffin M, Fisher P. The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol. 2007 Jul 3;7:30. http://dx.doi.org/10.1186/1471-2288-7-30 PMID:17608932
  22. Raglow GJ, Luby SP, Nabi N. Therapeutic injections in Pakistan: from the patients’ perspective. Trop Med Int Health. 2001 Jan;6(1):69–75. http://dx.doi.org/10.1046/j.1365-3156.2001.00653.x PMID:11263465
  23. Anand K, Panday CS, Kapoor SK. Injection use in a village in north India. Natl Med J India. 2001 May–Jun;14(3):143–144. PMID:11467141
  24. Gyawali S, Rathore DS, Shankar PR, Maskey M, Vikash KK. Injection practices in Nepal: health policymakers’ perceptions. BMC Int Health Hum Rights. 2014 Jun 24;14:21. http://dx.doi.org/10.1186/1472-698X-14-21 PMID:24957575
  25. Altaf A, Janjua NZ, Hutin Y. The cost of unsafe injections in pakistan and challenges for prevention program. J Coll Physicians Surg Pak. 2006 Sep;16(9):622–4. http://dx.doi.org/9.2006/JCPSP.622624 PMID:16945242
  26. Bhunia R, Hutin Y, Ramkrishnan R, Ghosh PK, Dey S, Murhekar M. Reducing use of injections through interactional group discussions: a randomized controlled trial. Indian Pediatr. 2010 May;47(5):409–14. http://dx.doi.org/10.1007/s13312-010-0076-4 PMID:19736370
  27. Kermode M, Muani V. Injection practices in the formal & informal healthcare sectors in rural north India. Indian J Med Res. 2006 Nov;124(5):513–20. PMID:17213519
  28. Kermode M, Holmes W, Langkham B, Thomas MS, Gifford S. Safer injections, fewer infections: injection safety in rural north India. Trop Med Int Health. 2005 May;10(5):423–32. http://dx.doi.org/10.1111/j.1365-3156.2005.01421.x PMID:15860088
  29. Altaf A, Shah SA, Shaikh K, Constable FM, Khamassi S. Lessons learned from a community based intervention to improve injection safety in Pakistan. BMC Res Notes. 2013 Apr 22;6:159. http://dx.doi.org/10.1186/1756-0500-6-159 PMID:23607289
  30. Friedman SR, Mateu-Gelabert P, Sandoval M, Hagan H, Des J, D.C. Positive deviance control-case life history: a method to develop grounded hypotheses about successful long-term avoidance of infection. BMC Public Health. 2008 Mar 20;8:94.
  31. Marsh DR, Schroeder DG, Dearden KA, Sternin J, Sternin M. The power of positive deviance. BMJ. 2004 Nov13;329(7475):1177–9. http://dx.doi.org/10.1136/bmj.329.7475.1177 PMID:15539680
  32. Lapping K, Marsh DR, Rosenbaum J, Swedberg E, Sternin J, Sternin M, et al. The positive deviance approach: challenges and opportunities for the future. Food Nutr Bull. 2002 Dec;23(4 Suppl):130–7. PMID:12503241