Designing and Psychometrics of Evaluation Tool for the Effectiveness of E-Learning during the Outbreak of COVID-19 among Students of Qazvin University of Medical Sciences

Document Type : Original Article (s)


1 Associate Professor, Emergency medicine specialist, Department of Emergency Medicine, Metabolic Disease Research Center, Qazvin University of Medical Science, Qazvin, Iran

2 Lecture of Nursing, Department of Nursing, Social Determinants of Health Research Center, Research Institute for Prevention of Non-Communicable Diseases, School of Nursing & Midwifery, Qazvin University of Medical Sciences, Qazvin, Iran

3 Assistant Professor, Department of Public Health, Qaen School of Medical Sciences, Birjand University of Medical Sciences, Birjand, Iran

4 Associate Professor,Department of Critical Care Nursing, Social Determinants of Health Research Center, Research Institute for Prevention of Non-Communicable Diseases, School of Nursing & Midwifery, Qazvin University of Medical Sciences, Qazvin, Iran


Background: The impacts of the growth of e-learning technology in medical sciences have been very significant, and it is essential to evaluate the dimensions of the effects of e-learning in medical sciences. The current study aimed to compile and psychometric test of a suitable tool to evaluate the effectiveness of e-learning among students during the COVID-19 pandemic.
Methods: This study is part of a larger study which was conducted using a combined consecutive method in 2020. It was designed and psychometrically analyzed in two stages. The literature review was used to design the questionnaire items. Face validity and content validity were evaluated quantitatively and qualitatively, and also construct validity (exploratory factor analysis), internal consistency (Cronbach's alpha), and stability (retest reliability) were evaluated.
Findings: The initial questionnaire was designed with 75 questions that after psychometric analyzed was reduced to 60 items with six dimensions. The six dimensions were named as follows: satisfaction, educational content, and materials; learning-teaching activities; feedback and evaluation and flexibility; fitness and workload; infrastructure, technology, and support. The results of total Cronbach's alpha of the tool were 0.95, retest with a correlation coefficient of 0.95 for the whole tool, and P < 0.001 showed that the instrument had desired reliability.
Conclusion: The tool for measuring the effectiveness of e-learning had validity and reliability in the target population of students. Therefore, this tool can be used for research, educational, and practical purposes and to evaluate the effectiveness of e-learning during the outbreak of COVID-19 among students.


Main Subjects

  1. Kheyrandish M. Expaining model of affecting factors on e-learning effectiveness in postgraduate courses [in Persian]. J Inf Technol Manag 2014; 6(4): 629-48.
  2. Kuhpayezadeh J, Afsharpor S, naghizadeh moogari, Z. Psychometric adequacy of the Persian version of the DELES questionnaire to evaluate the educational environment of environment of Iran University of Medical Sciences [in Persian]. Razi J Med Sci 2017; 24(159): 69-78.
  3. Kaur N, Dwivedi D, Arora J, Gandhi A. Study of the effectiveness of e-learning to conventional teaching in medical undergraduates amid COVID-19 pandemic. Natl J Physiol Pharm Pharmacol 2020; 10(07): 563-7.
  4. Chen R, Tseng HF. Factors that influence acceptance of web-based e-learning system for the inservice education of junior high school teachers in Taiwan. Eval Program Plann 2012; 35(4): 398-
  5. Khasawneh R, Simonsen K, Snowden J, Higgins J, Beck G. The effectiveness of e learning in pediatric medical student education. Med Educ Online 2016; 21: 29516.
  6. Nalini GK, Deepak P, Neelamma P, Sahana GN, Nagaral JV. Effectiveness of digital learning versus traditional learning among undergraduate students- prescription writing. Natl J Physiol Pharm Pharmacol 2020; 10(1): 9-14.
  7. Mărușteri M, Petrişor M, Oláh P, Haifa B, Bacârea V, Brînzaniuc K. Challenges in the design and development of a “third generation” e-learning/educational platform. In: Khosrow-Pour M, editor. Encyclopedia of information science and technology. 3rd Hershey, Pennsylvania: IGI Global; 2015. p. 1369-79
  8. Bussakorn C, Praweenya Critical success factors for online distance learning in higher education: A review of the literature. Creative Education 2012; 3(6): 61-6.
  9. Hosseini K, Nori H, Zabihi A. Adoption of e-learning higher education: Application of current theory, technology acceptance model and quality of electronic service [in Persian]. J Res Plann Higher Edu 2013; 19(67): 111-36.
  10. Hoy WH, Miskel CG, Tarter CJ. Educational administration: theory, research, and practice. English: 9th ed. New York, NY: McGraw-Hill; 2012.
  11. Yekefallah L, Namdar P, Panahi R, Dehghankar L.
    Factors related to students' satisfaction with holding e-learning during the Covid-19 pandemic based on the dimensions of e-learning. Heliyon 2021; 7(7): e07628.
  12. Hajizadeh A, Asghari M. Methods and statistical analysis by looking at the research method [in Persian]. Tehran, Iran: University Jihad Publishing Organization; 2011.
  13. Creswell JW, Clark P. Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications; Inc 2011. p. 16-38.
  14. Lobindo-Wood G, Haber J. Nursing research: Mehods and critical appraisal for evidence- based practice. 7th St. Louis, Missouri: Mosby; 2006:16-53.
  15. Wilson F, Robert PW, Schumsky DA. Recalculation of the critical values for Lawshe’s content validity ratio. Meas Eval Couns Dev 2012; 45(3): 197-210.
  16. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis.7th New York, NY: Pearson; 2009. p. 10-45.
  17. Nazari J, Mokhtari M. Factor analysis and its application in social sciences [in Persian]. Ketab Mah 2009; 13(14): 20-33.
  18. Munro BH, Aroian KJ. Statistical methods for health care research. 5th Philadelphia, PA: Lippincott Williams & Wilkins; 2005.
  19. Bashir K, Sharifah SSH, Ssekamanya SA, Mohd SN. Assessment of the psychometric properties of e-learning instructional design quality. African J Educ Sci Technol 2018; 4(4): 21-37.
  20. Sun PC, Tsai RJ, Finger G, Chen YY, Yeh D. What drives a successful e Learning? An empirical investigation of the critical factors influencing learner satisfaction. Comput Educ 2006; 50(4): 1183-202.
  21. Polit DF, Beck CT, Owen SV. Focus on research methods is the CVI an acceptable indicator of content validity. Appraisal and recommendations. Res Nurs Health 2007; 30: 459-67.
  22. Yasini A, Taban M. Study of the effectiveness of virtual education courses from the perspective of professors and students (Case study: University of Tehran) [in Persian]. Higher Educ in Iran 2015; 7(4): 175-98.
  23. Guillasper JN, Soriano GP, Michael FR. Psychometric properties of ‘attitude towards e-Learning scale’ among nursing students. Int J Educ Sci 2020; 30: 1-3.