Journal of Isfahan Medical School

Journal of Isfahan Medical School

Analysis ,Prioritization of Indicators for Measuring and Evaluating ‎Science, Technology, and Innovation in the Field of Dentistry

Document Type : Original Article (s)

Authors
Marjan Zareian 1
Sepideh Fahimifar 2
Mahshid Eltemasi 3
1 PhD student in Information Science and Knowledge Management, University of Tehran and Research Expert, Isfahan University of Medical Sciences, Isfahan, Iran
2 Associate Professor, Department of Information Science and Knowledge Management, School of Management, University of Tehran, Tehran, Iran
3 Assistant Professor, Department of Information Science and Knowledge Management, Faculty of Management, University of Tehran, Tehran, Iran
10.48305/jims.v43.i845.1854
Abstract
Background: Performance assessment in dentistry requires specialized frameworks that go beyond traditional scientometric indicators to focus on innovation, knowledge transfer, and systematic infrastructure. However, the lack of validated frameworks, especially in developing countries, is considered a significant research gap. This study aimed to develop a comprehensive framework for assessing science, technology, and innovation in dentistry.
Methods: This research was conducted with a combined approach (qualitative-quantitative) and mixed method. In the first stage, using the meta-synthesis method, 198 primary indicators were extracted from the analysis of 60 domestic and foreign scientific sources and categorized into 8 main components and 59 sub-components. In the second stage, for localization and validation, the Delphi method was used with the participation of 15 experienced experts in the field of dentistry. The Delphi process was conducted in three rounds and the final indicators were determined based on the mean score, standard deviation, and Kendall's coefficient of concordance.
Findings: After the Delphi process, 10 key indicators were identified in four main categories: 1) Scientific h-index and g-index of dentistry, number of international collaborations, 2) Technology indicators, 3) Innovation indicators, 4) Structural-evaluation indicators. The h-index of dentistry had the highest importance and agreement with a mean of 4.6 and a Kendall's coefficient of concordance of 0.82.
Conclusion: The findings of this study showed that evaluation in dentistry requires a multidimensional framework that, in addition to knowledge production, also considers technological, innovative, and structural dimensions. The proposed framework can be used as a valid tool in evaluation.

Highlights

Marjan Zareian: Google Scholar

Sepideh Fahimifar: Google Scholar

Keywords
Science indicators
Technology and innovation
Dentistry
Delphi method
Metasynthesis
Subjects
1.     Zarei A, Sedghi Z. A comparative study of scientific evaluation organizations based on scientometric indicators [in Persian]. Journal of Scientometrics 2017; 3(5): 49-66.
2.     Molanejad M, Alizadeh P. Science and Technology Assessment: Science and Technology Assessment System in Iran [in Persian]. Research Center of the Islamic Consultative Assembly. 2009; 1(1): 7-33.
3.      Maleki A, Yazdi N. Criteria for comparison and classification of models for monitoring and evaluating science, technology and innovation systems. Science and Technology Policy 2015; 5(1): 51-61.
4.     Adam F. Performance evaluation in healthcare: Approaches and applications. Springer; 2014.
5.     Arnold E, Balázs K. Evaluation of research and innovation policies: A practical guide. OECD Publishing; 2019.
6.     Aitsi-Selmi A, Murray V, Wannous C, Dickinson C, Johnston D, Kawasaki A, et al. Reflections on a science and technology agenda for 21st century disaster risk reduction. Int J Disaster Risk Sci 2016; 7(1): 1–29.
7.     Brown C, Wilson K, Farr M. Systematic approaches to research evaluation in health systems. Health Research Policy and Systems 2018; 16(1): 1–12.
8.     Egge L. Theory and practice of the g-index. Scientometrics 2011; 85(1): 145-57.
9.     Fagerberg J, Srholec M, Verspagen B. Innovation and economic development. Handbook of the Economics of Innovation 2010; 2: 833-72.
10.  James C, Colledge L, Meester W, Azoulay N, Plum A. CiteScore metrics: Creating journal metrics from the Scopus citation index. Learned Publishing 2019; 23: 367-74.
11.  Godin B. The political origin of the term "knowledge-based economy". Science and Public Policy 2006; 33(9): 659–66.
12.  Kaplan RS, Norton DP. The Balanced Scorecard: Translating strategy into action. Boston, MA: Harvard Business Press; 1996.
13.  Najafizadeh M, Arabi A. Scientific productivity and innovation in Iranian dentistry: A bibliometric analysis. Scientometrics 2022; 127(3): 1457–78.
14.  Wang V, Tucker JV, Rihll TE. On phatic technologies for creating and maintaining human relationships. Technology in Society 2011; 33(1-2): 44-51
15.  Klein M. Co-word analysis: A method for mapping the intellectual structure of a research field. Journal of Informetrics 2015; 9(3): 569–81.
16.  Lengrand L, Associés, SI. A practical guide to evaluating innovation programmes. European Communities; 2006.
17.   Mittelstadt BD. The ethics of data-driven healthcare innovation. Nature Medicine 2023; 29(4): 821–830.
18.  Mirzaei M. Challenges in dental research evaluation in Iran [in Persian]. Journal of Dental Education 2020; 84(5): 678–85.
19.  Oecd. The oslo manual: guidelines for collecting and interpreting innovation data. Oecd Publishing; 1995.
20.  Smith K. Measuring the impact of science: The use of bibliometrics in research evaluation. Minerva 2010; 48(4): 365–80.
21.  Tocan M. Altmetrics in medical research: Applications and challenges. PLOS One 2020; 15(7), e0235678.
22.  Vinkler P. Subfield problems in applying the Garfield (Impact) Factors in practice. Scientometrics 2002; 53(2): 267–79.
23.  Wang V, Tucker JV, Rihll TE. On phatic technologies for creating and maintaining human relationships. Technology in Society 2011; 33(1-2): 44-51.
Journal of Isfahan Medical School
Volume 43, Issue 845
1st Week, March
March and April 2026
Pages 1854-1863

  • Receive Date 18 August 2025
  • Accept Date 01 February 2026