ANALYSIS AND RESULTS: CONFIRMATORY FACTOR ANALYSIS THE MALAY VERSION OF DREEM INVENTORY WITH MEDICAL STUDENTS OF UNISZA, KUALA TERENGGANU, MALAYSIA

Authors

  • Mainul Haque Mainul Haque MBBS, MPhil, MSc (UK), CIDTT (UK) Professor of the Unit of Pharmacology Faculty of Medicine and Defence Health Universiti Pertahanan Nasional Malaysia (National Defence University of Malaysia) Kem Sungai Besi, 57000 Kuala Lumpur, Malaysia Land Line: +60 3 9051 3400 Ext 2257 (Office). +60 3 6179 5871 (Home) Cell Phone: + 60 10 926 5543 http://orcid.org/0000-0002-6124-7993
  • Muhamad Saiful Bahri Yusoff 2. Professor, Medical Education Department, School of Medical Sciences, Universiti Sains Malaysia, 16150 Kubang Kerian, Kota Bharu, Kelantan, Malaysia. Email: [email protected]
  • Md. Anwarul Azim Majumder 3. Director of Medical Education, Faculty of Medical Sciences, Cave Hill Campus, University of the West Indies, Barbados. Email: [email protected]
  • Zainal Zulkifli 4. Year-V Medical Student, Faculty of Medicine, Medical Campus, Universiti Sultan Zainal Abidin, Jalan Sultan Mahmud, 20400 Kuala Terengganu, Terengganu, Malaysia. Email: [email protected]
  • Farah Hanani Binti Mohd Nasir 5. Year-V Medical Student, Faculty of Medicine, Medical Campus, Universiti Sultan Zainal Abidin, Jalan Sultan Mahmud, 20400 Kuala Terengganu, Terengganu, Malaysia. Email: [email protected]

DOI:

https://doi.org/10.22159/ajpcr.2017.v10i12.21931

Keywords:

Confirmatory factor analysis, Malay version of DREEM, Malaysia

Abstract

 

 Objectives: The DREEM inventory has been universally established as a generic instrument to assess health-related educational programs. There were some apprehensions regarding the psychometric properties of the DREEM raised in last few years. This study evaluated first ever the psychometric properties of the Bahasa Melayu version of the DREEM in a sample of Malaysian medical students.

Methods: A cross-sectional study was carried and universal sampling method was applied. Researchers selected 1-5th-year medical students of Universiti Sultan Zainal Abidin, Malaysia, as study subjects. Researchers collected data through a guided self-administered questionnaire during a face-to-face session.

Results: Confirmatory factor analysis (CFA) showed that the one factor model of DREEM-M (Model A), consisting 50 items were not fit, indicating it was a multidimensional instrument. On further CFA, it appeared that the proposed five-factor structure was not fit (Model B) as all the goodness-of-fit indices did not signify a model fit.

Conclusions: The study findings revealed that the DREEM inventory 50-item inventory failed to achieve a model fit, but it demonstrated a high of internal consistency. The proposed 19-item DREEM-M revealed good model fit.

Downloads

Download data is not yet available.

Author Biographies

Mainul Haque, Mainul Haque MBBS, MPhil, MSc (UK), CIDTT (UK) Professor of the Unit of Pharmacology Faculty of Medicine and Defence Health Universiti Pertahanan Nasional Malaysia (National Defence University of Malaysia) Kem Sungai Besi, 57000 Kuala Lumpur, Malaysia Land Line: +60 3 9051 3400 Ext 2257 (Office). +60 3 6179 5871 (Home) Cell Phone: + 60 10 926 5543

Pharmacology

Md. Anwarul Azim Majumder, 3. Director of Medical Education, Faculty of Medical Sciences, Cave Hill Campus, University of the West Indies, Barbados. Email: [email protected]

Medical Education

Zainal Zulkifli, 4. Year-V Medical Student, Faculty of Medicine, Medical Campus, Universiti Sultan Zainal Abidin, Jalan Sultan Mahmud, 20400 Kuala Terengganu, Terengganu, Malaysia. Email: [email protected]

House Officer

Farah Hanani Binti Mohd Nasir, 5. Year-V Medical Student, Faculty of Medicine, Medical Campus, Universiti Sultan Zainal Abidin, Jalan Sultan Mahmud, 20400 Kuala Terengganu, Terengganu, Malaysia. Email: [email protected]

House Officer

References

The Executive Council of the World Federation for Medical Education (WFME): International standards in medical education: assessment and accreditation of medical schools’ - educational programs. A WFME position paper. Med Educ 1998, 32 (5): 549-558.

Chandran CR, Ranjan R. Students’ perceptions of educational climate in a new dental college using the DREEM tool. Adv Med Educ Pract 2015; 6: 83-92. doi:10.2147/AMEP.S74314.

Bakhshialiabad H, Bakhshi M, Hassanshahi G. Students’ perceptions of the academic learning environment in seven medical sciences courses based on DREEM. Adv Med Educ Pract 2015; 6: 195-203. doi:10.2147/AMEP.S60570.

Cunningham J, Wright C, Baird M. Managing Clinical Education Through Understanding Key Principles. Radiol Technol 2015; 86 (3): 257-273.

Hammond SM, O'Rourke M, Kelly M, Bennett D, O' Flynn S. A psychometric appraisal of the DREEM. BMC Med Educ 2012; 12(1): 2. DOI: 10.1186/1472-6920-12-2

Roff S, Mcaleer S, Harden RM, Al-Qahtani M, Ahmed AU, Deza H, Groenen G. Primparyon P. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Med Teach 1997; 19 (4): 295-299. Doi.org/10.3109/01421599709034208

Rothman AI, Ayoade F. The development of a learning environment: a questionnaire for use in curriculum evaluation. J Med Educ 1970, 45: 754-759.

Marshall RE. Measuring the medical school learning environment. J Med Educ 1978, 53: 98-104.

Feletti GI, Clarke RM. Review of psychometric features of the medical school learning environment survey. Med Educ 1981, 15: 92-96. DOI: 10.1111/j.1365-2923. 1981. tb02403.x

Moore-west M, Harrington DL, Mennin SP, Kaufman A, Skipper BJ. Distress and attitudes toward the learning environment: effects of a curriculum innovation. Teach Learn Med 1989, 1: 151-157. Doi.org/10.1080/10401338909539400

General Medical council: Tomorrow’s Doctors. Recommendations on Undergraduate Medical Education London, General Medical Council; 1993. Available at http://www.gmc-uk.org/Tomorrow_s_Doctors_1214.pdf_48905759.pdf [Accessed on March 26, 2017]

Chan DSK. Combining qualitative and quantitative methods in assessing hospital learning environments. Int J Nurs Stud 2001, 38: 447-459.

Mulroney A. Development of an instrument to measure the Practice Vocational Training Environment in Ireland. Med Teach. 2005, 27(4): 338-342. Doi.org/10.1371/journal.pone.0137872

Rahman NIA, AA, Zulkifli Z, Haj MA, Nasir FHBM, Pergalathan S, Hamidi MI, Ismail S, Simbak NB, Haque M. Perceptions of students in different phases of medical education of the educational environment: Universiti Sultan Zainal Abidin. Adv Med Educ Pract 2015; 6: 211–222. Doi: 10.2147/AMEP.S78838.

Mohsena M, Debsarma S, Haque M. Determining the Quality of Educational Climate in a Private Medical College in Bangladesh via the ‘Dundee Ready Education Environment Measure’ Instrument. J Young Pharm 2016; 8(3): 266-274. Doi:10.5530/jyp.2016.3.17

Roff S. The Dundee Ready Educational Environment Measure (DREEM)–a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. Med Teach 2005, 27: 322-325. Doi.org/10.1080/01421590500151054

Said NM, Rogayah J, Hafizah A. A Study of Learning Environments in the Kulliyyah (Faculty) of Nursing, International Islamic University Malaysia. Malay J Med Sci 2009, 16: 11-20.

Thomas BS, Abraham RR, Alexander M, Ramnarayan K. Students’ perceptions regarding educational environment in an Indian dental school. Med Teach 2009, 31: 185-188. Doi: 10.1080/01421590802516749.

Till H. Identifying the perceived weaknesses of a new curriculum by means of the Dundee Ready Education Environment Measure (DREEM) Inventory. Med Teach 2004, 26: 39-45. Doi.org/10.1080/01421590310001642948

Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: A systematic review. Med Teach 2010, 32: 947-952. Doi: 10.3109/01421591003686229.

Vaughan B, Mulcahy J, McLaughlin P. The DREEM, part 2: psychometric properties in an osteopathic student population. BMC Med Educ 2014; 14: 100. Doi: 10.1186/1472-6920-14-100

Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: A review. J Educ Res 2006; 99(6): 323-338. Doi.org/10.3200/JOER.99.6.323-338

Said H, Badru BB, Shahid M. Confirmatory Factor Analysis (CFA) for Testing Validity and Reliability Instrument in the Study of Education. Aus J Basic Appli Sci 2011; 5(12): 1098-1103.

Hernandez R. A short form of the subjective well-being scale for Filipinos. EME Rev 2010; 1: 105-115.

Cabrera P. Author Guidelines for Reporting Scale Development and Validation Results in the Journal of the Society for Social Work and Research. J Soc Social Work Res 2010; 1(2): 99-103. Doi: 10.5243/jsswr.2010.8

Jung J, Neumann M, Wirtz M, Ernstmann N, Staratschek-Jox A, Wolf J, Pfaff H. Validation of the SmoCess-GP†instrument - a short patient questionnaire for assessing the smoking cessation activities of general practitioners: a cross-sectional study. BMC Fam Pract 2010; 11:9. DOI: 10.1186/1471-2296-11-9

Atkinson TM, Rosenfeld BD, Sit L, et al. Using Confirmatory Factor Analysis to Evaluate Construct Validity of the Brief Pain Inventory (BPI). J Pain Symptom Manage 2011; 41(3): 558-565. Doi: 10.1016/j.jpainsymman.2010.05.008.

Kalk K, Luik P, Taimalu M, Täht K. Validity and Reliability of Two Instruments to Measure Reflection: A Confirmatory Study. TRAMES 2014; 18(68/63): 2, 121–134.

Hadie SNH, Yusoff MSB. Assessing the validity of the cognitive load scale in a problem-based learning setting. J Taibah Univ Med Sci 2016; 11(3): 194e202. Doi.org/10.1016/j.jtumed.2016.04.001

Majeed AA, Darmawan GN, Lynch P. A Confirmatory Factor Analysis of Attitudes Toward Mathematics Inventory (ATMI). Math Educ 2013; 15 (1): 121-135.

Malaysian Qualifications Agency. Code of Practice for Program Accreditation. 2nd ed. Petaling Jaya, Selangor Darul Ehsan, Malaysia: Malaysian Qualifications Agency; 2008.

Malaysian Qualifications Agency. Code of Practice for Institutional Audit. 1st ed. Petaling Jaya, Selangor Darul Ehsan, Malaysia: Malaysian Qualifications Agency; 2008.

Ismail S, Salam A, Alattraqchi AG, Annamalai L, Chockalingam A, Elena WP, Rahman NIA, Abubakar AR, Haque M. Evaluation of doctors’ performance as facilitators in basic medical science lecture classes in a new Malaysian medical school. Adv Med Edu Pract 2015; 6: 231–237. Doi: 10.2147/AMEP.S78441

Bhagat V, Haque M, Simbak NB, Jaalam K. Study on personality dimension negative emotionality affecting the academic achievement among Malaysian medical students studying in Malaysia and Overseas. Adv Med Edu Pract 2016; 7: 341–346. Doi: 10.2147/AMEP.S108477

Haque M, Rahman NAA, Majumder MAA, Haque SZ, Kamal ZM, Islam MZ, Haque ATME, Rahman NIA, Alattraqchi AG. Internet use and addiction among medical students of Universiti Sultan Zainal Abidin, Malaysia. Psychol Res Behav Manag 2016; 9: 297-307. Doi.org/10.2147/PRBM.S119275

Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract Assess Res Eval 2005; 10(7): 1-9.

McAleer S, Roff S. A practical guide to using the Dundee Ready Education Environment Measure (DREEM). AMEE Medical Education Guide 2001; 23: 29-33.

Roff S, McAleer S. What is educational climate? Med Teach. 2001; 23(4): 333. Doi.org/10.1080/01421590120063312

Khan JS, Tabasum S, Yousafzai UK, Fatima M. DREEM ON: Validation of the Dundee Ready Education Environment Measure in Pakistan. J Pak Med Assoc 2011; 61(9): 885-888.

Dimoliatis I, Vasilaki E, Anastassopoulos P, Ioannidis J, Roff S. Validation of the Greek translation of the Dundee ready education environment measure (DREEM). Educ Health 2010; 23(1): 348.

Jakobsson U, Danielsen N, Edgren G. Psychometric evaluation of the Dundee Ready Educational Environment Measure: Swedish version. Med Teach 2011; 33(5): 267-274. Doi: 10.3109/0142159X.2011.558540.

Riquelme A, Oporto M, Oporto J, Mendez JI, Viviani P, Salech F, Chianale J, Moreno R, Sánchez I. Measuring students' perceptions of the educational climate of the new curriculum at the Pontificia Universidad Catalica de Chile: performance of the Spanish translation of the Dundee Ready Education Environment Measure (DREEM). Educ Health 2009; 22(1):112.

Yusoff MSB. The Dundee Ready Educational Environment Measure: A Confirmatory Factor Analysis in a Sample of Malaysian Medical Students. Int J Hum Soc Sci 2012; 2(16): 313-21.

Yusoff MSB. Stability of DREEM in a Sample of Medical Students: A Prospective Study. Educ Res Int 2012: 1-5. Doi.org/10.1155/2012/509638

Haque M, Zulkifli Z, Nasir FHBM, Majumder MAA, Yusoff MSB, Mustafa A, Hoque R, Islam MZI, Aung MMT. Perception of Tomorrow’s Health-Care Connoisseur and Front-Runners of Their Educational Environment Utilizing DREEM Inventory in Bahasa Melayu version, The Native Language of Malaysia. Aus Med J 2017; 10(5): 396-412.

Yusoff MS, Arifin WN. Educational environment and psychological distress of medical students: The role of a deep learning approach. J Taibah Univ Med Sci 2015; 10(4): 411-418. Doi.org/10.1016/j.jtumed.2015.08.005

Brown TA. Confirmatory factor analysis for applied sciences. New York: The Guilford Press; 2006.

Arbuckle JL. IBM SPSS Amos 19 user's guide. Chicago, US: IBM; 1995. Available from: http://www.amosdevelopment.com/download/amos.pdf [Accessed on March 15, 2017].

Kline RB. Principles and Practice of Structural Equation Modeling. 3rd ed. New York: Guilford Publications; 2010.

Piaw CY. Statistik Penyelidikan Lanjutan. Malaysia: McGraw Hill; 2009.

Browne MW, Cudeck R. Alternative ways of assessing model fit. Soc Method Res. 1992; 21(2): 230-258.

Jöreskog K, Sörbom D. LISREL VI users guide. 3rd ed. Moorsville. In: Scientific Software]is; 1984.

Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990; 107(2): 238.

Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull 1980; 88(3): 588.

Bollen KA. A new incremental fit index for general structural equation models. Soc Method Res 1989; 17(3): 303-316.

Marsh HW, Hocevar D. Application of confirmatory factor analysis to the study of self-concept: First-and higher order factor models and their invariance across groups. Psychol Bull 1985; 97(3): 562.

Nunally JC. Psychometric theory. 2nd ed. New York: McGraw Hill; 1978.

Streiner LD, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. New York: Oxford University Press; 2008.

Yusoff MSB, Rahim AFA, Yaacob M. The Development and Validity of the Medical Student Stressor Questionnaire (MSSQ). ASEAN J Psychiatr 2010; 11(1): 1-12.

Genn JM. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education – a unifying perspective. Med Teach 2001; 23: 337-44. Doi: 10.1080/01421590120063330

Rotem A, Bloomfield L, Southon G. The clinical learning environment. Isr J Med Sci 1996; 32: 705-710.

Mogre V, Amalba A. Psychometric Properties of the Dundee Ready Educational Environment Measure in a Sample of Ghanaian Medical Students. Educ Health 2016; 29: 16-24. Doi: 10.4103/1357-6283.178921.

Yusoff MSB. Psychometric properties of DREEM in a sample of Malaysian medical students. Med Teach 2012; 34 (7): 595-596.

Nunnally JC, Bernstein IH. Psychometric theory. New York, NY: McGraw-Hill, 1994.

Ostapczuk MS, Hugger A, De Bruin J, Ritzâ€Timme S, Rotthoff T. DREEM on, dentists! Students’ perceptions of the educational environment in a German dental school as measured by the Dundee Ready Education Environment Measure. Eur J Den Educ 2012; 16(2): 67-77. Doi: 10.1111/j.1600-0579.2011.00720. x.

Rotthoff T, Ostapczuk MS, De Bruin J, Decking U, Schneider M, Ritz-Timme S. Assessing the learning environment of a faculty: psychometric validation of the German version of the Dundee Ready Education Environment Measure with students and teachers. Med Teach 2011; 33(11): e624-636. Doi: 10.3109/0142159X.2011.610841.

Published

01-12-2017

How to Cite

Haque, M., M. S. B. Yusoff, M. A. A. Majumder, Z. Zulkifli, and F. H. B. Mohd Nasir. “ANALYSIS AND RESULTS: CONFIRMATORY FACTOR ANALYSIS THE MALAY VERSION OF DREEM INVENTORY WITH MEDICAL STUDENTS OF UNISZA, KUALA TERENGGANU, MALAYSIA”. Asian Journal of Pharmaceutical and Clinical Research, vol. 10, no. 12, Dec. 2017, pp. 338-44, doi:10.22159/ajpcr.2017.v10i12.21931.

Issue

Section

Original Article(s)

Most read articles by the same author(s)