Introduction
Healthcare organizations encounter difficulties in several critical domains, despite employing diverse advanced methodologies and tools. Data envelopment analysis (DEA) is a non-parametric method in the field of operational research (OR), mainly utilized for evaluating the relative efficiency and productivity of decision-making units (DMUs) across various sectors, with a notable application in healthcare systems. Nunamaker, in 1983, employed the DEA for the first time to assess the technical efficiency of 16 hospitals in Wisconsin, USA. Within the healthcare context, DEA serves as a valuable tool for evaluating the performance of hospitals, clinics, and other healthcare providers, pinpointing inefficiencies, and identifying opportunities for improvement that can enhance the quality and efficiency of healthcare services. While DEA holds significant promise for transformation and offers robust analytical capabilities, it has its own limitations and challenges that should be addressed to fully realize its benefits. Therefore, this study aims to review the challenges and benefits of DEA in evaluating the performance of healthcare systems.
Methods
In this narrative review study, a search for related articles in English or Persian published from 2010 to 2024 was conducted in Medline, Google Scholar, PubMed, Science Direct, Scopus, and Scientific Information Database (SID) databases using the keywords DEA, Efficiency, Opportunities, and Healthcare system. Initially, 76 articles were found. Then, according to the review criteria, 31 articles with available full texts were selected and reviewed completely.
Results
Challenges of applying DEA
Complexity of health care services
DEA results are significantly influenced by the selected inputs and outputs, and omitting critical variables may lead to inaccurate results. This challenge is particularly evident in the healthcare sector, where it is often difficult to quantify all relevant dimensions. Factors such as the variety of services provided by centers, the types of available treatments, and the patient’s medical condition contribute to this complexity and may overshadow the actual performance of health care centers and complicate the interpretation of DEA findings.
Data quality and availability
Inadequate data quality can lead to poor healthcare services, which in turn increases costs and reduces productivity. Sometimes data may be incomplete, heterogeneous, or inaccessible. The effectiveness of DEA depends on the availability and quality of data, which is a major challenge in the healthcare sector.
Dynamic and diverse nature of health care
In the medical field, diversity pertains to healthcare professionals, trainees, educators, researchers, and patients who come from different backgrounds, including race, ethnicity, gender, social class, socioeconomic status, primary language, and geographic location. Furthermore, the constant changes in laws, treatment protocols, and technological advances that characterize the healthcare sector further complicate the standardization of services across different healthcare units.
Resistance to change
Change, especially in the healthcare field, represents a complex and challenging phenomenon, and an organization’s ability to adapt is of paramount importance to its survival. Implementing the DEA and subsequent actions based on its results may even encounter resistance from health care managers and professionals. Some may perceive that the DEA acts primarily as a mechanism to punish misperformance rather than to improve the efficiency of the system. To effectively address this resistance, it is essential to demonstrate the benefits of DEA in improving health care delivery by establishing clear communications and providing the necessary educational resources.
Benefits of DEA
Benchmarking
DEA plays a vital role in identifying health and medical units with optimal performance that demonstrate superior efficiency. By identifying benchmarks based on these exemplary units, DEA offers valuable targets for decision-makers and policymakers. This information is particularly beneficial for those overseeing healthcare systems, as it highlights areas that need improvement and helps them perform optimally by directing available resources toward underperforming centers.
Resource allocation and optimization
Healthcare sectors consist of a set of input and output variables, such as the size of hospitals, the number and type of specialists, the rate of patient admission and discharge, and the level of patient satisfaction with treatment, that help to clarify the complex interactions between available resources and overall system performance. DEA helps health care managers understand how resources are utilized across different units. By identifying inefficient units, managers can optimize resource allocation and ensure that each unit is operating at its maximum capacity.
Performance improvement
Effective performance management is essential for improving the quality of healthcare systems through optimizing effectiveness and efficiency. In general, performance management encompasses a wide range of activities including defining, planning, measuring, monitoring, and ultimately improving the performance of a system.
Policy formulation
Efficiency is one of the most potent measures of health system performance. Insights gained from efficiency evaluations can guide targeted interventions to improve performance. DEA can also identify specific areas where efficiency gains are possible. It can help policymakers develop strategies to increase efficiency and improve healthcare, thereby ensuring equitable access to quality care for patients. DEA can provide evidence-based knowledge that can guide the development of future health system policies.
Patient-centred care
In the digital era landscape, the integration of technology into public services is clearly evident as a fundamental element for enhancing productivity and service delivery in various sectors, such as healthcare systems. By focusing on outcomes such as patient satisfaction and treatment outcomes, DEA encourages a shift towards patient-entered care. Health care providers with the accurate knowledge gained through DEA and observing its positive results in patient treatment, can be able align with the overall goals of healthcare systems.
Conclusion
The DEA offers significant opportunities for enhancing healthcare management through efficiency assessment and benchmarking; however, there are some challenges for its implementation. Overcoming these challenges requires a committed approach to improving data collection practices, building an organizational culture to create sustainable progress, and adapting DEA techniques to the specific conditions in different health sectors. When successfully implemented, DEA can lead to substantial improvements in resource allocation, patient-centered care, and overall health system performance. The DEA models can be used to monitor the performance of healthcare systems over time, thereby assisting health policymakers in identifying areas for improvement and implementing strategies to achieve better outcomes.
Ethical Considerations
Compliance with ethical guidelines
This is a review study and did not involve any human or animal experiments. Therefore, it did not require an ethical code.
Funding
This research did not receive any grant from funding agencies in the public, commercial, or non-profit sectors.
Authors contributions
All authors contributed equally to the conception and design of the study, data collection and analysis, interpretation of the results, and drafting of the manuscript. Each author approved the final version of the manuscript for submission.
Conflicts of interest
The authors declared no conflict of interest.
References
- Routers. U.S. healthcare spending rises to $4.8 trillion in 2023, outpacing GDP [Internet]. 2024 [Updated 2024 June 13] Available from: [Link]
- Koengkan M, Fuinhas JA, Kazemzadeh E, Osmani F, Alavijeh NK, Auza A, et al. Measuring the economic efficiency performance in Latin American and Caribbean countries: An empirical evidence from stochastic production frontier and data envelopment analysis. International Economics. 2022; 169:43-54. [DOI:10.1016/j.inteco.2021.11.004]
- Cylus, J, Papanicolas I, Smith PC. Using data envelopment analysis to address the challenges of comparing health system efficiency. Global Policy. 2017; 8(S2):60-8. [DOI:10.1111/1758-5899.12212]
- Zarrin M, Schoenfelder J, Brunner JO. Homogeneity and best practice analyses in hospital performance management: An analytical framework. Health Care Management Science. 2022; 25(3):406-25. [DOI:10.1007/s10729-022-09590-8] [PMID] [PMCID]
- Nepomuceno TCC, Costa APCS, Daraio C. Theoretical and empirical advances in the assessment of productive efficiency since the introduction of DEA: A bibliometric analysis. International Journal of Operational Research. 2023; 46(4):505-49. [DOI:10.1504/IJOR.2023.129960]
- Andrews A, Emvalomatis G. Efficiency measurement in healthcare: The foundations, variables, and models-A narrative literature review. Economics. 2024; 18(1):20220062. [DOI:10.1515/econ-2022-0062]
- Huang L, Wenqian LV, Huang Q, Zhang H , Jin S, Chen T, et al. Medical equipment effectiveness evaluation model based on cone-constrained DEA and attention-based bi-LSTM. Scientific Reports. 2024; 14(1):9324. [DOI:10.1038/s41598-024-59852-4] [PMID] [PMCID]
- Alatawi AD, Niessen LW, Khan, JA. Efficiency evaluation of public hospitals in Saudi Arabia: An application of data envelopment analysis. BMJ Open. 2020; 10(1): e031924. [DOI:10.1136/bmjopen-2019-031924] [PMID] [PMCID]
- Kohl S, Schoenfelder J, Fügener A, Brunner JO. The use of data envelopment analysis (DEA) in healthcare with a focus on hospitals. Health Care Management Science. 2019; 22(2):245-86. [DOI:10.1007/s10729-018-9436-8] [PMID]
- Vajjhala NR, Eappen P. Data envelopment analysis in healthcare management: Overview of the latest trends. In: Ajibesin AA, Vajjhala NR, editors. Data Envelopment Analysis (DEA) methods for maximizing efficiency. Hershey: IGI Global; 2024. [DOI:10.4018/979-8-3693-0255-2.ch011]
- Medarević A, Vuković D. Efficiency and productivity of public hospitals in Serbia using DEA-malmquist model and tobit regression model, 2015-2019. International Journal of Environmental Research and Public Health. 2021; 18(23):12475. [DOI:10.3390/ijerph182312475] [PMID] [PMCID]
- Martínez-García M, Lemus E. Health systems as complex systems. American Journal of Operations Research. 2013; 3(1A):113-26. [DOI:10.4236/ajor.2013.31A011]
- Carroll A, Stokes D, Darley A. Use of complexity theory in health and social care: A scoping review protocol. BMJ Open. 2021; 11(7):e047633. [DOI:10.1136/bmjopen-2020-047633] [PMID] [PMCID]
- Krijgsheld M, Schmidt E JET, Levels E, Schuurmans M MJ. Healthcare professionals as change agents: Factors influencing bottom-up, personal initiatives on appropriate care, a qualitative study in the Netherlands. Health Policy. 2024; 147:105120. [DOI:10.1016/j.healthpol.2024.105120] [PMID]
- Chen KC, Lin SY, Yu MM. Exploring the efficiency of hospital and pharmacy utilizations in Taiwan: An application of dynamic network data envelopment analysis. Socio-Economic Planning Sciences. 2022; 84:101424. [DOI:10.1016/j.seps.2022.101424]
- Liu F, Li L, Ye B, Qin Q. A novel stochastic semi-parametric frontier-based three-stage DEA window model to evaluate China's industrial green economic efficiency. Energy Economics. 2023; 119:106566. [DOI:10.1016/j.eneco.2023.106566]
- Gerami J. An interactive procedure to improve estimate of value efficiency in DEA. Expert Systems with Applications. 2019; 137:29-45. [DOI:10.1016/j.eswa.2019.06.061]
- Mohanta KK, Sharanappa DS, Aggarwal A. A novel modified Khatter’s approach for solving Neutrosophic data envelopment analysis. Croatian Operational Research Review. 2023; 14(1):15-28. [DOI:10.17535/crorr.2023.0002]
- Daneshkohan A, Alimoradi M, Ahmadi M, Alipour J. Data quality and data use in primary health care: A case study from Iran. Informatics in Medicine Unlocked. 2022; 28:100855. [DOI:10.1016/j.imu.2022.100855]
- Tolera A, Firdisa D, Roba HS, Motuma A, Kitesa M, Abaerei AA. Barriers to healthcare data quality and recommendations in public health facilities in dire Dawa city administration, eastern Ethiopia: A qualitative study. Frontiers in Digital Health. 2024; 14(6):1261031. [DOI:10.3389/fdgth.2024.1261031] [PMID] [PMCID]
- Bernardi FA, Alves D, Crepaldi N, Yamada DB, Lima VC, Rijo R. Data quality in health research: Integrative literature review. Journal of Medical Internet Research. 2023; 25:e41446. [DOI:10.2196/41446] [PMID] [PMCID]
- Togioka BM, Young E. Diversity and discrimination in health care. Treasure Island: Stat Pearls Publishing; 2024. [Link]
- Vitezić N, Cankar SS, Linšak Ž. Effectiveness measurement using DEA & BSC methods in public health services. NISPAcee Journal of Public Administration and Policy. 2019; 12(1):199-216. [DOI:10.2478/nispa-2019-0009]
- Cheraghi R, Ebrahimi H, Kheibar N, Sahebihagh MH. Reasons for resistance to change in nursing: An integrative review. BMC Nursing. 2023; 22(1):310. [DOI:10.1186/s12912-023-01460-0] [PMID] [PMCID]
- Abdelfattah W, Alanazi BS. Application of data envelopment analysis to evaluate health regions efficiency in Saudi Arabia.Engineering, Technology & Applied Science Research. 2024; 14(3):13902-908. [DOI:10.48084/etasr.7176]
- Beiter D, Koy S, Flessa S. Improving the technical efficiency of public health centers in Cambodia: A two-stage data envelopment analysis. BMC Health Services Research. 2023; 23(1):912. [DOI:10.1186/s12913-023-09570-w] [PMID] [PMCID]
- Chorfi Z, Benabbou, L, Berrado A. An integrated performance measurement framework for enhancing public health care supply chains. Supply Chain Forum. 2018; 19(3):191-203. [DOI:10.1080/16258312.2018.1465796]
- Mostepaniuk A, Akalin T, Parish MR. Practices pursuing the sustainability of a healthcare organization: A Systematic Review. Sustainability. 2023; 15(3):2353. [DOI:10.3390/su15032353]
- Alshahrani SH, Alshahrani TH, Paulsamy P, Ederango EL. Patient centered care and centeredness perspective. Universal Journal of Public Health. 2022; 10(4):339-45. [DOI:10.13189/ujph.2022.100407]
- Kwilinski A, Szczepanska-Woszczyna K, Lyulyov O, Pimonenko T. Digital public services: Catalysts for healthcare efficiency. Journal of Open Innovation: Technology, Market, and Complexity. 2024; 10(3):100319. [DOI:10.1016/j.joitmc.2024.100319]