Eastern Mediterranean Health Journal | All issues | Volume 20, 2014 | Volume 20, issue 12 | Physicians’ attitudes towards interaction with the pharmaceutical industry

Physicians’ attitudes towards interaction with the pharmaceutical industry

Print

PDF version

F.D. Alosaimi,1 A. Al Kaabba,2 M. Qadi,3 A. Albahlal,1 Y. Alabdulkarim,1 M. Alabduljabbar 1 and F. Alqahtani 1

مواقف الأطباء من التفاعل مع صناعة المستحضرات الصيدلانية

فهد العصيمي، عبد العزيز القبّاع، مهدي قاضي، عبد الله البهلال، ياسر عبد الكريم، محمد العبد الجبار، فيصل القحطاني

الخلاصة: يترتب على العلاقة بين الأطباء وصناعة المستحضرات الصيدلانية آثارٌ أخلاقيةٌ تتعلق برعاية المرضى. وقد تناولت هذه الدراسة معرفة الأطباء العاملين في المملكة العربية السعودية بصناعة المستحضرات الصيدلانية ومواقفهم منها، وارتباط ذلك بسلوكهم الفعلي. ففي دراسة مستعرضة أجريت عام 2012 تم إنشاء سُلَّم (درجات) ذي 100 نقطة من سلم أسئلة ليكرت البالغ عددها 175 نقطة لتقييم المعارف والمواقف. وكان إجمالي الدرجات المحرَزة لـ 659 مشاركاً 63.1 (±8.5)، مع غالبية تحمل موقفاً ايجابياً بشكل عام. وكانت أعلى (أي: أفضل) الدرجات المحرَزة مرتبطة – إلى حد كبير - بعدم وجود تفاعل مع صناعة المستحضرات الصيدلانية وبرفض الهدايا الصيدلانية، وليس بالتربية المتعلقة بالأخلاقيات. وفي تحليل متعدد المتغيرات وُجد أن رفض الهدايا والدخلَ الإضافي والجنسية السعودية ظلت مرتبطة - بشكل مستقل – بإحراز أعلى الدرجات. عموماً، كانت هناك معرفة دون المستوى الأمثل وموقف إيجابي – بشكل عام - من صناعة المستحضرات الصيدلانية لدى هذه العينة من الأطباء في المملكة العربية السعودية.

ABSTRACT The relationship between physicians and the pharmaceutical industry has ethical implications for patient care. This study examined knowledge and attitudes towards the pharmaceutical industry, and associations with actual behaviour, among physicians working in Saudi Arabia. In a cross-sectional study in 2012, a 100-point score was created from 17 5-point Likert-scale questions to assess knowledge and attitudes. The overall score of 659 participants was 63.1 (SD 8.5), with a majority holding a generally positive attitude. Higher (i.e. better) scores were significantly associated with a lack of interactions with the pharmaceutical industry and with refusal of gifts but not with education about ethics. In multivariate analysis, refusing gifts, additional income and Saudi nationality remained independently associated with higher scores. Overall, there was suboptimal knowledge and a generally positive attitude towards the pharmaceutical industry among the sample of physicians in Saudi Arabia.

Attitudes des médecins par rapport à l'interaction avec l'industrie pharmaceutique

RÉSUMÉ Les relations entre les médecins et l'industrie pharmaceutique ont des implications éthiques pour les soins aux patients. La présente étude a examiné les connaissances et les attitudes envers l'industrie pharmaceutique, ainsi que les associations avec les comportements réels chez des médecins exerçant en Arabie saoudite. Dans une étude transversale menée en 2012, un score sur 100 a été créé à partir de 17 questions sur une échelle de Likert en 5 points visant à évaluer les connaissances et les attitudes. Le score global des 659 participants était de 63,1 (ET 8,5), la majorité ayant généralement une attitude positive. Les scores les plus élevés (c'est-à-dire les meilleurs scores) étaient nettement associés à une absence d'interactions avec l'industrie pharmaceutique et le refus de cadeaux, mais n'étaient pas liés à une formation sur l’éthique. À l'analyse multivariée, le refus de cadeaux, des revenus supplémentaires ainsi que la nationalité saoudienne étaient des facteurs indépendamment associés à des scores plus élevés. Globalement, les connaissances étaient sous-optimales et l'attitude envers l'industrie pharmaceutique était généralement positive au sein de l'échantillon de médecins répondeurs en Arabie saoudite.

1King Saud University, Riyadh, Saudi Arabia (Correspondence to: This e-mail address is being protected from spambots. You need JavaScript enabled to view it ). 2Imam Muhammad Ibn Saud Islamic University, Riyadh, Saudi Arabia. 3King Abdulaziz University, Jeddah, Saudi Arabia.

Received: 16/12/13; accepted: 20/05/14


Introduction

There is accumulating evidence from different parts of the world indicating that nearly all physicians maintain some sort of relationship with the pharmaceutical industry (1–3). This relationship may be seen as beneficial to patients, as physicians and the pharmaceutical industry have common interests in conducting research and developing new, safe and effective medications (4). On the other hand, the relationship may be seen as harmful to patients, due to the conflict of interest between the physician, whose primary interest is patients’ welfare, and the pharmaceutical industry, which has a primary interest in maximizing profits for shareholders (4,5). This raises numerous ethical questions about the appropriateness of physicians’ accepting gifts, the degree of transparency and disclosure of received benefits, the impact on health-care costs, influences on health-care decisions, the effect on the research agenda and its results, and the impact on the physician–patient relationship (6–8).

The attitude of physicians towards their relationship with the pharmaceutical industry has been examined in a number of studies (9–11) and the possibility that such a relationship may influence physicians’ clinical decision-making has been also examined (12). However, there are limited data linking physicians’ knowledge and attitude with their own behaviour towards the pharmaceutical industry. Moreover, studies examining the attitude of physicians towards the relationship are completely lacking in Saudi Arabia. The objective of the current study was to examine knowledge and attitudes towards the pharmaceutical industry among physicians working in Saudi Arabia, including accepting gifts, ethical issues, influence on clinical decisions and accuracy of information provided. Additionally, the study aimed to examine the association of such knowledge and attitudes with physicians’ own behaviour towards any sort of interaction with the pharmaceutical industry and accepting pharmaceutical company gifts.

Methods

Study design and setting

A cross-sectional study was carried between March and July 2012. The study obtained all required ethical approvals from the institutional review board at the Faculty of Medicine at King Saud University, Riyadh, Saudi Arabia.

Approximately 80% of the health-care services in Saudi Arabia including prescriptions are provided free of charge by the government (13). The private sector provides fee-paid services and is considered a more easily accessible sector compared with the government sector. However, the cost is largely covered by private employers who are required by law to provide free insurance to their employees (13).

Population

The current study was conducted among physicians working in secondary- and tertiary-care hospitals in Saudi Arabia. All ranks of physicians of both medical and surgical specialties were included. Samples were recruited from 10 hospitals (both government and private) in the Central, Eastern, Western, Northern and Southern regions of Saudi Arabia. Medical students and other health-care workers were excluded. Physicians without patient care responsibilities were excluded.

We estimated that 631 participants were required to detect a 20% difference in attitude towards the pharmaceutical industry (for example, 50% versus 30%) between 2 levels of a given characteristics (such as having or lacking medical education), at 95% confidence level and 80% power.

Because of the difficulty of getting rosters of working physicians for each hospital, we recruited the required sample size from the physicians available at the time of the study (convenience sample). We distributed 1000 questionnaire in both paper (75%) and electronic (25%) formats and obtained 663 responses. Four questionnaires were excluded due to lack of interaction questions, leaving 659 for analysis. Informed consent was obtained from all participants after explanation of the study objectives.

Data collection tool

A self-administrated questionnaire was developed and administered to all participants. It first asked about the sociodemographic, economic and occupational characteristics of the study participants. The questionnaire then assessed outcome variables, including history of any interaction with pharmaceutical sales representatives, the physician’s acceptance of pharmaceutical company gifts and any ethics education received. Pharmaceutical company gifts in the current study were described in the questionnaire as stationery items, free drug samples, free meals, financial support to attend educational activities, funding for research and prepaid promotion cards/codes. The participants were asked to answer 17 questions to assess their knowledge and attitude towards gifts, medical ethics, influences on care decisions and the accuracy of information given by pharmaceutical sales representatives about new pharmaceutical medications. Ten of these questions were general and were answered by everyone, while 7 questions were answered only by those who had a history of actual interactions with pharmaceutical sales representatives. The content of the questionnaire was validated by a multidisciplinary committee covering ethics, psychiatry, pharmacy and epidemiology. The questionnaire was then piloted on a small number of participants (n = 16) before widespread distribution. The wording and suggested answers were modified for some questions based on the feedback from the pilot sample. The internal consistency of the questionnaire items was examined using Cronbach alpha (with a value of 0.55).

Data analysis

Data were presented using frequencies and percentages for categorical data and mean and standard deviation (SD) for continuous data. Knowledge and attitude questions were presented as frequencies and percentages. Questions were answered using 5-point Likert scales. For the majority of questions, strongly agree/always was assigned a score of 5 and strongly disagree/never was assigned a score of 1. A few questions were worded in the opposite direction and so scored in the opposite direction with strongly disagree/never assigned a score of 5 and strongly agree/always assigned a score of 1 (Table 1). Overall or group scores were calculated by summing the individual scores of their items (10 general questions, 7 interaction questions and overall score). Scores were then transformed into 100-point scales with 100 = best knowledge and attitude and 20 = worst knowledge and attitude. Significant differences in transformed scores by sociodemographic, occupations and outcome characteristics were examined using t-test or 1-way analysis of variance (ANOVA), as appropriate. Mean scores by outcome variables adjusted for significant associates were created using general linear model regression analysis. All P-values were 2-tailed. P-value < 0.05 was considered as significant. SPSS software, version 20.0, was used for statistical analyses.

Results

Data from 659 participants were analysed. Approximately three-quarters of the participants (74.5%) were male and the average age was 38.2 (SD 10.0) years. More than half (54.9%) of the participants were Saudi Arabian nationals and less than a third (30.8%) had received medical education outside the region, in North America, western Europe or Australia. The most commonly reported monthly income (41.5%) was between US$ 2700 and US$ 5200.

Physicians’ knowledge and attitudes towards pharmaceutical companies and representatives

A total 659 participants answered the questions about knowledge and attitudes to pharmaceutical company representatives in general (Table 1). More than half (52.1%) of the participants disagreed that accepting pharmaceutical company gifts could affect their own decisions, but a much lower percentage (32.0%) disagreed that accepting pharmaceutical company gifts could affect the decisions of other physicians (Table 1). Only a small percentage (16.3%) of the participants thought it was ethical to accept pharmaceutical company gifts and 43.6% agreed that pharmaceutical companies should be banned from giving gifts to physicians. More than half (51.6%) of the participants disagreed that patients should be informed about the gifts given to their doctors by drug companies. About 41.2% of the participants disagreed that pharmaceutical sales representatives always provided accurate information about their new products. Participants were equally divided (34.0% agree and 32.1% disagree) about whether receiving details from pharmaceutical sales representatives would increase their preference for prescribing the promoted drug. About 37.9% of the participants disagreed that drug information from pharmaceutical sales representatives influenced their decisions and the majority of the participants (67.5%) believed that drug information from other sources was more important and reliable than from pharmaceutical sales representatives.

Physicians’ experiences with pharmaceutical sales representatives

Physicians were who had ever met pharmaceutical industry representatives (n = 460) answered questions about their experience of these interactions (Table 2). The majority (75.2%) of the physicians agreed that pharmaceutical representatives frequently (usually or always) used the word “safe” when they described their products (Table 2). Less than a quarter of the participants thought that pharmaceutical representatives frequently (always or usually) mentioned the drug’s interactions (19.7%), adverse effects (20.4%) and price (23.6%) without being asked. The majority of the participants believed that representatives were sometimes convincing (54.4%). The majority of the participants admitted they had frequently (29.7%) or at least sometimes (30.8%) been requested by representatives to try a new medicine on their patients.

Mean overall knowledge and attitude scores

The mean overall knowledge and attitude score was 63.1 [standard deviation (SD 8.5)]. Similarly, the mean score for the general questions was 62.8 (SD 10.1) and for the interaction questions was 63.0 (SD 9.1). The knowledge and attitudes scores according to participants’ sociodemographic and occupational characteristics are shown on Tables 3 and 4 respectively. Since the 3 scores were very close and had the same pattern of associations with almost all the studied variables, we will restrict this description to the overall score.

There were inverse associations between the overall score and participants’ age, as evidenced by the higher score with younger age and shorter work duration (P < 0.001 for each). Participants of Saudi Arabian nationality had a significantly higher overall score than non-Saudis (P < 0.001). The overall score was significantly higher among those working in public hospitals (P < 0.001) and among those with additional income (P < 0.001). Participants with monthly income US$ 2700–5200 had a significantly lower overall score than other groups (P = 0.024). There were no significant differences in the overall scores by physician’s sex, medical education, clinical specialty, job rank or work history.

Associations of physicians’ characteristics with overall knowledge and attitude scores

We examined the associations between the overall knowledge and attitude score and the study outcome variables. The participants with previous experience of interacting with pharmaceutical sales representatives (n = 460) had a higher overall mean score than those with no previous interaction (n = 199) [64.7 (SD 10.0) versus 62.5 (SD 7.8)] (P = 0.004). Similarly, the participants who did not accept pharmaceutical company gifts (n = 69) had a higher overall score than those who accepted them (n = 383) [65.2 (SD 9.0) versus 61.9 (SD 7.4)] (P = 0.001). Participants who reported having some type of education (lectures, workshops, etc.) about the ethics of interactions with the pharmaceutical industry (n = 341) had a slightly higher overall score than those who did not have such education (n = 289). However, the difference did not reach statistical significance [63.8 (SD 9.2) versus 62.8 (SD 7.7)] (P = 0.151).

In multivariate analysis, adjusting for the above outcome variables as well as the variables associated with the overall score in univariate analysis (Tables 3 and 4) including age, nationality, type of hospital, working duration and additional income, it was found that refusing gifts (model coefficient β = 2.25, P = 0.037), having additional income (β = 3.42, P = 0.001) and Saudi nationality (β = 3.37, P < 0.001) were independently associated with a higher overall knowledge and attitude score.

Table 3 Mean knowledge and attitudes scores according to the sociodemographic and educational characteristics of the study physicians
Table 4 Mean knowledge and attitudes scores according to the occupational characteristics of the study physicians 

Discussion

We report here the knowledge and attitudes towards the pharmaceutical industry of a group of physicians of different clinical specialties and job ranks working in Saudi Arabia and the associations with their own behaviour. The current findings showed a generally positive attitudes towards interactions with the pharmaceutical industry. Similarly, a thematic review of studies examining the attitudes and knowledge towards the pharmaceutical industry between 1996 and 2004 showed that a substantial numbers of physicians found interactions with pharmaceutical industry representatives to be appropriate, important, beneficial or ethical and felt that they should be permitted (14). Similar findings were replicated in more recent studies in developed (2,9,15) and developing countries (16). Although less than half of physicians in the current study supported banning pharmaceutical company gifts and only a quarter supported disclosing received gifts to their patients, the majority of them did not find it ethical to accept pharmaceutical company gifts. This may reflect a limited awareness of the impact of interactions or unacknowledged bias due to conflicts of interest (17).

Despite data that has linked accepting gifts to the prescribing behaviour of physicians (12), the influence on clinical decisions is often unacknowledged by many physicians who believe they can adequately evaluate and filter information presented to them by pharmaceutical sales representatives (14,17). Physicians in the current study tended to ignore the impact of accepting pharmaceutical company gifts and receiving details from pharmaceutical sales representatives on their own clinical decisions. Interestingly, they also underestimated the influence on themselves compared with their colleagues. Similarly, a number of studies showed that physicians and nurses believed they are more immune to industry influence than their colleagues are (14,15,18). As in other studies in developed and developing countries, the majority of physicians in the current study had doubts about the accuracy of drug safety information provided by pharmaceutical sales representatives (16,19,20). Supporting our finding about physicians’ trust in non-pharmaceutical representative sources, it has been shown that physicians believed that practice guidelines, peer-reviewed evidence and opinions of local physician experts are important counterweights to the influence of pharmaceutical sales representatives (21).

The knowledge and attitude scores in the current study were transformed into 100-point scales for easy interpretation. Since the overall score was 63, this may roughly indicate a suboptimal level of information among the studied physicians. Although we have reported some sociodemographic, occupational and behavioural factors significantly associated with knowledge and attitudes, the absolute differences rarely exceeded 5 points. However, these small differences between factor groups were the average of much bigger differences in individual questions, sometimes in opposite directions. For example, those who accepted gifts were 50% less likely to believe that gift acceptance was unethical but 15% more likely to deny the influence on their decisions.

As expected, better knowledge and attitudes about interactions with the pharmaceutical industry in the current study were associated with refusal of pharmaceutical company gifts. This may indicate the importance of good knowledge and correct attitudes about interactions with the pharmaceutical industry. It has been shown that education and discussion about the ethical issues related to exposure to pharmaceutical representatives can improve the attitudes of residents and medical students towards interactions (22–25). Interestingly, knowledge and attitudes about interactions with the pharmaceutical industry in the current study was not significantly associated with having received ethics education. While this may be difficult to explain, it may simply indicate inadequate or insufficient ethics education offered to the studied physicians. These educational activities were predominantly in the form of lectures, limiting the role of more interactive educational activities. It has been shown that active learning strategies such as brainstorming sessions, role plays and group activities were effective in improving the knowledge, attitudes and skills of medical students about pharmaceutical promotion (26).

The current study had many advantages: bridging the local knowledge gap about attitudes towards interactions with pharmaceutical industry, surveying a relatively large number of physicians across several specialties and linking the knowledge and attitudes with behaviours. Nevertheless, we acknowledge a number of limitations. Being based on a convenience sample, the results should be generalized with caution and should not be regarded as representative of all physicians working in Saudi hospitals. Being a self-reported study, the possibility of reporting bias concerning attitudes or underestimation of interactions with the pharmaceutical industry cannot be excluded. The questionnaire in its final version had a poor indicator for internal consistency of its items (as indicated by an overall Cronbach alpha value of 0.55). Therefore, the reliability of the questionnaire can be doubted and the findings should be interpreted with caution, reflecting the need of a standard questionnaire to assess physicians’ attitudes towards the pharmaceutical industry.

In conclusion, we report suboptimal knowledge and a generally positive attitude towards the pharmaceutical industry among a group of physicians working in Saudi Arabia. As the majority of physicians were in the habit of accepting gifts, the majority found it ethical to interact with the pharmaceutical industry representatives and tended to overlook any potential influences on clinical decision-making. Better knowledge and attitudes in the current study were independently associated with refusal of pharmaceutical company gifts, additional income and Saudi nationality. Improving the knowledge and attitudes of physicians may reduce the frequency of their interactions and influences from the pharmaceutical industry. Active learning strategies about appropriate industry interactions and awareness of local governing policies should be included in medical school curricula and residency training programmes.

Acknowledgements

Funding: The authors would like to extend their sincere appreciation to the Deanship of Scientific Research at King Saud University for funding this research group (No. RG-1435-087).

Competing interests: None declared.

References

  1. Campbell EG, Gruen RL, Mountford J, Miller LG, Cleary PD, Blumenthal D. A national survey of physician–industry relationships. N Engl J Med. 2007 Apr 26;356(17):1742–50. PMID:17460228
  2. Saito S, Mukohara K, Bito S. Japanese practicing physicians’ relationships with pharmaceutical representatives: a national survey. PLoS One. 2010;5(8):e12193. PMID:20730093
  3. McNeill PM, Kerridge IH, Henry DA, Stokes B, Hill SR, Newby D, et al. Giving and receiving of gifts between pharmaceutical companies and medical specialists in Australia. Intern Med J. 2006 Sep;36(9):571–8. PMID:16911549
  4. Komesaroff PA. Ethical issues in the relationships with industry: an ongoing challenge. New guidelines open for public comment. J Paediatr Child Health. 2005 Nov;41(11):558–60. PMID:16398836
  5. Brennan TA, Rothman DJ, Blank L, Blumenthal D, Chimonas SC, Cohen JJ, et al. Health industry practices that create conflicts of interest: a policy proposal for academic medical centers. JAMA. 2006 Jan 25;295(4):429–33. PMID:16434633
  6. Marco CA, Moskop JC, Solomon RC, Geiderman JM, Larkin GL. Gifts to physicians from the pharmaceutical industry: an ethical analysis. Ann Emerg Med. 2006 Nov;48(5):513–21. PMID:17052550
  7. Chren MM, Landefeld CS, Murray TH. Doctors, drug companies, and gifts. JAMA. 1989 Dec 22-29;262(24):3448–51. PMID:2585690
  8. Chimonas S, Rozario NM, Rothman DJ. Show us the money: lessons in transparency from state pharmaceutical marketing disclosure laws. Health Serv Res. 2010 Feb;45(1):98–114. PMID:19840133
  9. Korenstein D, Keyhani S, Ross JS. Physician attitudes toward industry: a view across the specialties. Arch Surg. 2010 Jun;145(6):570–7. PMID:20566978
  10. Castresana L, Mejia R, Aznar M. Actitud de los medicos frente a las practicas de promocion de la industria farmaceutica. [The attitude of physicians regarding the promotion strategies of the pharmaceutical industry]. Medicina (B Aires). 2005;65(3):247–51. PMID:16042137
  11. Moubarak G, Martins RP, Zuily S, Mechulan A, Hariri S, Guiot A. Attitudes of cardiology residents toward interactions with the pharmaceutical industry. Int J Cardiol. 2011 Feb 3;146(3):461–2. PMID:21122930
  12. Spurling GK, Mansfield PR, Montgomery BD, Lexchin J, Doust J, Othman N, et al. Information from pharmaceutical companies and the quality, quantity, and cost of physicians’ prescribing: a systematic review. PLoS Med. 2010 Oct;7(10):e1000352. PMID:20976098
  13. Almalki M, Fitzgerald G, Clark M. Health care system in Saudi Arabia: an overview. East Mediterr Health J. 2011 Oct;17(10):784–93. PMID:22256414
  14. Zipkin DA, Steinman MA. Interactions between pharmaceutical representatives and doctors in training. A thematic review. J Gen Intern Med. 2005 Aug;20(8):777–86. PMID:16050893
  15. Jutel A, Menkes DB. “But doctors do it...”: nurses’ views of gifts and information from the pharmaceutical industry. Ann Pharmacother. 2009 Jun;43(6):1057–63. PMID:19470854
  16. Ben Abdelaziz A, et al. [Attitudes of general practitioners to pharmaceutical sales representatives in Sousse] [in Arabic]. East Mediterr Health J. 2003 Sep-Nov;9(5-6):1075–83. PMID:16450540
  17. Fischer MA, Keough ME, Baril JL, Saccoccio L, Mazor KM, Ladd E, et al. Prescribers and pharmaceutical representatives: why are we still meeting? J Gen Intern Med. 2009 Jul;24(7):795–801. PMID:19424764
  18. Vancelik S, Beyhun NE, Acemoglu H, Calikoglu O. Impact of pharmaceutical promotion on prescribing decisions of general practitioners in Eastern Turkey. BMC Public Health. 2007;7:122. PMID:17592644
  19. Othman N, Vitry AI, Roughead EE, Ismail SB, Omar K. Medicines information provided by pharmaceutical representatives: a comparative study in Australia and Malaysia. BMC Public Health. 2010;10:743. PMID:21118551
  20. Mintzes B, Lexchin J, Sutherland JM, Beaulieu MD, Wilkes MS, Durrieu G, et al. Pharmaceutical sales representatives and patient safety: a comparative prospective study of information quality in Canada, France and the United States. J Gen Intern Med. 2013 Oct;28(10):1368–75. PMID:23558775
  21. Naik AD, Woofter AL, Skinner JM, Abraham NS. Pharmaceutical company influence on nonsteroidal anti-inflammatory drug prescribing behaviors. Am J Manag Care. 2009 Apr;15(4):e9–15. PMID:19341315
  22. Hopper JA, Speece MW, Musial JL. Effects of an educational intervention on residents’ knowledge and attitudes toward interactions with pharmaceutical representatives. J Gen Intern Med. 1997 Oct;12(10):639–42. PMID:9346461
  23. Kao AC, Braddock C 3rd, Clay M, Elliott D, Epstein SK, Filstead W, et al. Effect of educational interventions and medical school policies on medical students’ attitudes toward pharmaceutical marketing practices: a multi-institutional study. Acad Med. 2011 Nov;86(11):1454–62. PMID:21952057
  24. Wofford JL, Ohl CA. Teaching appropriate interactions with pharmaceutical company representatives: the impact of an innovative workshop on student attitudes. BMC Med Educ. 2005 Feb 8;5(1):5. PMID:15698480
  25. Kelcher S, Brownoff R, Meadows LM. Structured approach to pharmaceutical representatives. Family medicine residency program. Can Fam Physician. 1998 May;44:1053–6, 1059–60. PMID:9612591
  26. Shankar PR, Singh KK, Piryani RM. Knowledge, attitude and skills before and after a module on pharmaceutical promotion in a Nepalese medical school. BMC Res Notes. 2012;5:8. PMID:22221485