×

A multicriteria decision-making framework for assessing the performance of gynecobstetrics departments: a case study. (English) Zbl 07744649

Summary: Gynecobstetrics departments (GDs) oversee diagnosing, monitoring, and treating female reproductive diseases as well as assisting women during pregnancy. Their importance motivates the creation of suitable performance evaluation approaches for identifying weaknesses and designing focused interventions. Therefore, the aim of this paper is twofold: (a) provide an approach for GD performance evaluation and (b) propose interventions tackling the GDs’ weaknesses. The fuzzy analytic hierarchy process (FAHP) was first applied to calculate the initial criteria and subcriteria weights under vagueness. Then, the decision-making trial and evaluation laboratory (DEMATEL) was implemented to evaluate interrelations. FAHP and DEMATEL were later combined to estimate the final criteria and subcriteria weights under vagueness and interdependency. Finally, the technique for order of preference by similarity to ideal solution (TOPSIS) was used to rank the GDs and detect improvement opportunities. A case study of a cluster including three GDs is presented to validate the proposed approach. The results evidenced that patient safety and service quality are the most critical aspects in GD performance evaluation. The results from this application can be used by healthcare managers for designing focused interventions targeting improved performance of GDs. This paper fully exploits the advantages of FAHP, DEMATEL, and TOPSIS methods for evaluating performances of GDs. Furthermore, this study presents a novel decision-making model representing the multifactorial context of the GD performance.
{© 2021 The Authors. International Transactions in Operational Research © 2021 International Federation of Operational Research Societies.}

MSC:

90-XX Operations research, mathematical programming
Full Text: DOI

References:

[1] Abdulgader, F.S., Eid, R., Rouyendegh, B., 2018. Development of decision support model for selecting a maintenance plan using a fuzzy MCDM approach: a theoretical framework. Applied Computational Intelligence and Soft Computing2018, 1-14.
[2] Abdullah, L., Zulkifli, N., 2015. Integration of fuzzy AHP and interval type‐2 fuzzy DEMATEL: an application to human resource management. Expert Systems with Applications42, 9, 4397-4409.
[3] Agrawal, V., Seth, N., Dixit, J.K., 2020. A combined AHP-TOPSIS-DEMATEL approach for evaluating success factors of e‐service quality: an experience from Indian banking industry. Electronic Commerce Research1-33. https://doi.org/10.1007/s10660-020-09430-3 · doi:10.1007/s10660-020-09430-3
[4] Akdag, H., Kalayci, T., Karagöz, S., Zülfikar, H., Giz, D., 2014. The evaluation of hospital service quality by fuzzy MCDM. Applied Soft Computing Journal23, 239-248.
[5] Albahri, A.S., Zaidan, A.A., Albahri, O.S., Zaidan, B.B., Alsalem, M.A., 2018. Real‐time fault‐tolerant mhealth system: comprehensive review of healthcare services, opens issues, challenges and methodological aspects. Journal of Medical Systems42, 8, 137.
[6] Alomi, Y.A., Al‐Shubaar, N., Lubad, N., Albusalih, F.A., 2019. Adherence assessment of medication errors reporting system at the public hospital in Riyadh, Saudi Arabia. International Journal of Pharmacology and Clinical Sciences8, 2, 105-109.
[7] Ang, S., Zhu, Y., Yang, F., 2021. Efficiency evaluation and ranking of supply chains based on stochastic multicriteria acceptability analysis and data envelopment analysis. International Transactions in Operational Research28, 6, 3190-3219. · Zbl 07769643
[8] Anggraeni, W., Kusumawardani, R.P., Ardianto, R.D., 2014. Penerapan fuzzy analytical hierarchy process pada sistem penilaian pegawai di rumah sakit onkologi Surabaya. Seminar Nasional Sistem Informasi Indonesia (SESINDO) in Surabaya, Indonesia. Departemen Sistem Informasi, Institut Teknologi Sepuluh Nopember, Surabaya, Jawa Timur, Indonesia, pp. 409-414.
[9] Antony, J., Zarin, W., Pham, B., Nincic, V., Cardoso, R., Ivory, J.D., Ghassemi, M., Barber, S.L., Straus, S.E., Tricco, A.C., 2018. Patient safety initiatives in obstetrics: a rapid review. BMJ Open8, 7, e020170.
[10] Araujo, C.A.S., Wanke, P., Siqueira, M.M., 2018. A performance analysis of Brazilian public health: TOPSIS and neural networks application. International Journal of Productivity and Performance Management67, 9, 1526-1549.
[11] Ashtiani, B., Haghighirad, F., Makui, A., Montazer, G.A., 2009. Extension of fuzzy TOPSIS method based on interval‐valued fuzzy sets. Applied Soft Computing Journal9, 2, 457-461.
[12] Aydin, M.A., Gokcen, H.B., 2019. Factors considered by patients in provider selection for elective specialty surgery: a questionnaire‐based survey. International Journal of Surgery69, 43-48.
[13] Ayhan, M.B., 2013. A fuzzy AHP Approach for supplier selection problem: A case study in a gearmotor company. International Journal of Managing Value and Supply Chains4, 3, 11.
[14] Bahadori, M.K., Abolghasemi, K., Eymourzadeh, E., 2017. Performance evaluation and ranking of selective wards in a military hospital using DEA and PROMETHEE method. Journal of Military Medicine18, 4, 325-334.
[15] Bajracharya, A.S., Crotty, B.H., Kowoloff, H.B., Safran, C., Slack, W.V., 2019. Patient experience with family history tool: analysis of patients’ experience sharing their family health history through patient‐computer dialogue in a patient portal. Journal of the American Medical Informatics Association26, 7, 603-609.
[16] Barrios, M.A.O., De Felice, F., Negrete, K.P., Romero, B.A., Arenas, A.Y., Petrillo, A., 2016. An AHP‐topsis integrated model for selecting the most appropriate tomography equipment. International Journal of Information Technology and Decision Making15, 4, 861-885.
[17] Baykasoǧlu, A., Kaplanoglu, V., Durmuşoglu, Z.D.U., Şahin, C., 2013. Integrating fuzzy DEMATEL and fuzzy hierarchical TOPSIS methods for truck selection. Expert Systems with Applications40, 3, 899-907.
[18] Büyüközkan, G., Ifi, G., 2012. A novel hybrid MCDM approach based on fuzzy DEMATEL, fuzzy ANP and fuzzy TOPSIS to evaluate green suppliers. Expert Systems with Applications39, 3, 3000-3011.
[19] Büyüközkan, G., Çifçi, G., 2012. A combined fuzzy AHP and fuzzy TOPSIS based strategic analysis of electronic service quality in healthcare industry. Expert Systems with Applications39, 3, 2341-2354.
[20] Büyüközkan, G., Feyzioǧlu, O., Gocer, F., 2016. Evaluation of hospital web services using intuitionistic fuzzy AHP and intuitionistic fuzzy VIKOR. IEEE International Conference on Industrial Engineering and Engineering Management, Bali, pp. 607-611.
[21] Chahal, K., Eldabi, T., Young, T., 2013. A conceptual framework for hybrid system dynamics and discrete event simulation for healthcare. Journal of Enterprise Information Management26, 1, 50-74.
[22] Chan, H.K., Sun, X., Chung, S.H., 2019. When should fuzzy analytic hierarchy process be used instead of analytic hierarchy process?Decision Support Systems125, 113114.
[23] Chou, S., Chang, Y., Shen, C., 2008. A fuzzy simple additive weighting system under group decision‐making for facility location selection with objective/subjective attributes. European Journal of Operational Research189, 1, 132-145. · Zbl 1147.90350
[24] Cook, A., Gaynor, M., Stephens, M.Jr., Taylor, L., 2012. The effect of a hospital nurse staffing mandate on patient health outcomes: evidence from California’s minimum staffing regulation. Journal of Health Economics31, 2, 340-348.
[25] Coto, J.A., Wilder, C.R., Wynn, L., Ballard, M.C., Webel, D., Petkunas, H., 2020. Exploring the relationship between patient falls and levels of nursing education and certification. The Journal of Nursing Administration50, 1, 45-51.
[26] De Matteis, D., Ishizaka, A., Resce, G., 2019. The “postcode lottery” of the Italian public health bill analysed with the hierarchy stochastic multiobjective acceptability analysis. Socio‐Economic Planning Sciences68, 1-9.
[27] deOliveira, N.A., Luz, M.R., Saraiva, R.M., Alves, L.A., 2011. Student views of research training programmes in medical schools. Medical Education45, 7, 748-755.
[28] Dey, P.K., Hariharan, S., Despic, O., 2008. Managing healthcare performance in analytical framework. Benchmarking15, 4, 444-468.
[29] Diaby, V., Dias, L., 2017. Beyond value function methods in MCDA for health care. In Marsh, K. (ed.), Goetghebeur, M. (ed.), Thokala, P (ed.)., Baltussen, R. (ed.) (eds) Multi‐Criteria Decision Analysis to Support Healthcare Decisions. Springer, Cham, pp. 299-310.
[30] Escobar‐Díaz, F.A., Castillo‐Santana, P.T., Rodríguez‐Salazar, N., Quintero‐Cabezas, C.J., Castañeda‐Orjuela, C.A., 2017. Experiences in construction, dissemination and use of the health situation analysis in Colombia 2016. Revista de Salud Publica19, 3, 368-373.
[31] Farley, H., Enguidanos, E.R., Coletti, C.M., Honigman, L., Mazzeo, A., Pinson, T.B., Reed, K., Wiler, J.L., 2014. Patient satisfaction surveys and quality of care: An information paper. Annals of Emergency Medicine64, 4, 351-357.
[32] Fletcher, L., Carter, M., Lyubovnikova, J., 2018. Congruency of resources and demands and their effects on staff turnover within the English health care sector. Journal of Occupational and Organizational Psychology91, 3, 688-696.
[33] Gabus, A., Fontela, E., 1972. World Problems, an Invitation to Further Thought Within the Framework of DEMATEL. Battelle Geneva Research Center, Geneva, pp. 1-8.
[34] Gabus, A., Fontela, E., 1973. Perceptions of the world problematique: communication procedure, communicating with those bearing collective responsibility. DEMATEL Report No. 1, Battelle Geneva Research Center, Geneva.
[35] Gaeta, M., Campanella, F., Capasso, L., Schifino, G.M., Gentile, L., Banfi, G., Pellissero, G., Ricci, C., 2017. An overview of different health indicators used in the European Health Systems. Journal of Preventive Medicine and Hygiene58, 2, 114-120.
[36] Giannini, M., 2015. Performance and quality improvement in healthcare organizations. International Journal of Healthcare Management8, 3, 173-179.
[37] Grigoroudis, E., Orfanoudaki, E., Zopounidis, C., 2012. Strategic performance measurement in a healthcare organisation: a multiple criteria approach based on balanced scorecard. Omega40, 1, 104-119.
[38] Gündoğdu, F.K., Kahraman, C., 2020. Hospital performance assessment using interval‐valued spherical fuzzy analytic hierarchy process. In Kahraman, C., Kutlu Gündoğdu, F. (eds) Decision Making with Spherical Fuzzy Sets. Springer, Cham, pp. 349-373.
[39] Hobday, R.A., Dancer, S.J., 2013. Roles of sunlight and natural ventilation for controlling infection: Historical and current perspectives. Journal of Hospital Infection84, 4, 271-282.
[40] Ishizaka, A., 2014, Comparison of fuzzy logic, AHP, FAHP and hybrid fuzzy AHP for new supplier selection and its performance analysis. International Journal of Integrated Supply Management9, 1, 1-22.
[41] Ishizaka, A., Nemery, P., 2013. Multi‐Criteria Decision Analysis: Methods and Software. Wiley, Chichester, pp. 1-296.
[42] Jain, V., Sangaiah, A.K., Sakhuja, S., Thoduka, N., Aggarwal, R., 2018, Supplier selection using fuzzy AHP and TOPSIS: a case study in the Indian automotive industry. Neural Computing and Applications29, 7, 555-564.
[43] Jayant, A., Agarwal, A., 2019. A novel hybrid MCDM approach based on DEMATEL, AHP and TOPSIS to evaluate green suppliers. Journal of Physics: Conference Series1240, 1, 012010).
[44] Karsak, E.E., Karadayi, M.A., 2017. Imprecise DEA framework for evaluating health‐care performance of districts. Kybernetes46, 4, 706-727.
[45] Keely, E., Liddy, C., Afkham, A., 2013. Utilization, benefits, and impact of an e‐consultation service across diverse specialties and primary care providers. Telemedicine and e‐Health19, 10, 733-738.
[46] Kohl, S., Schoenfelder, J., Fügener, A., Brunner, J.O.2019. The use of data envelopment analysis (DEA) in healthcare with a focus on hospitals. Health Care Management Science22, 2, 245-286.
[47] Koumaditis, K., Themistocleous, M., Rupino da Cunha, P., 2013. SOA implementation critical success factors in healthcare. Journal of Enterprise Information Management26, 4, 343-362.
[48] Lagravinese, R., Liberati, P., Resce, G., 2019. Exploring health outcomes by stochastic multicriteria acceptability analysis: an application to Italian regions. European Journal of Operational Research274, 3, 1168-1179. · Zbl 1430.90393
[49] Lagravinese, R., Liberati, P., Resce, G., 2020. Measuring Health Inequality in US: a composite index approach. Social Indicators Research147, 3, 921-946.
[50] Lahdelma, R., Hokkanen, J., Salminen, P., 1998. SMAA—stochastic multiobjective acceptability analysis. European Journal of Operational Research106, 1, 137-143.
[51] Lalor, D., 2011. Medicines labelling. Australian Prescriber34, 5, 136-138.
[52] Leccese, F., Montagnani, C., Iaia, S., Rocca, M., Salvadori, G., 2016. Quality of lighting in hospital environments: a wide survey through in situ measurements. Journal of Light and Visual Environment40, 52-65.
[53] Lee, S.F., Lee, W.S., 2013. Promoting the quality of hospital service for children with developmental delays. The Service Industries Journal33, 15-16, 1514-1526.
[54] Levesque, J.F., Sutherland, K., 2020. Combining patient, clinical and system perspectives in assessing performance in healthcare: an integrated measurement framework. BMC Health Services Research20, 1, 1-14.
[55] Lin, Q., Liu, L., Liu, H., Wang, D., 2013. Integrating hierarchical balanced scorecard with fuzzy linguistic for evaluating operating room performance in hospitals. Expert Systems with Applications40, 6, 1917-1924.
[56] Longaray, A., Ensslin, L., Ensslin, S., Alves, G., Dutra, A., Munhoz, P., 2018. Using MCDA to evaluate the performance of the logistics process in public hospitals: the case of a Brazilian teaching hospital. International Transactions in Operational Research25, 1, 133-156. · Zbl 1390.90031
[57] Lupo, T., 2016. A fuzzy framework to evaluate service quality in the healthcare industry: an empirical case of public hospital service evaluation in Sicily. Applied Soft Computing Journal40, 468-478.
[58] Mao, N., Song, M., Pan, D., Deng, S., 2018. Comparative studies on using RSM and TOPSIS methods to optimize residential air conditioning systems. Energy144, 98-109.
[59] Mardani, A., Hooker, R.E., Ozkul, S., Yifan, S., Nilashi, M., Sabzi, H.Z., Fei, G.C., 2019. Application of decision making and fuzzy sets theory to evaluate the healthcare and medical problems: a review of three decades of research with recent developments. Expert Systems with Applications137, 202-231.
[60] McAlister, F.A., Youngson, E., Bakal, J.A., Holroyd‐Leduc, J., Kassam, N., 2015. Physician experience and outcomes among patients admitted to general internal medicine teaching wards. CMAJ187, 14, 1041-1048.
[61] Mensah, J.Asamoah, D., Tawiah, A.A., 2014. Optimizing patient flow and resource utilization in out patient clinic: a comparative study of Nkawie Government Hospital and Aniwaa Health Center. Journal of Applied Business and Economics16, 3, 181-188.
[62] Miettinen, K., Ruiz, F., Wierzbicki, A.P., 2008. Introduction to multiobjective optimization: interactive approaches. In Branke, J. (ed.), Deb, K. (ed.), Miettinen, K. (ed.), Słowiński, R. (ed.) (eds) Multiobjective Optimization. Springer, Berlín, pp. 27-57. · Zbl 1147.68304
[63] Ministerio de Salud y Protección Social, 2016. Sistema de Evaluación del Desempeño del Sistema de Salud bajo Criterios OCDE COLOMBIA: Guía Metodológica. Available at https://www.minsalud.gov.co/sites/rid/Lists/BibliotecaDigital/RIDE/VS/ED/GCFI/guia-ross-ocde.pdf (accessed 26 March 2020).
[64] Mosadeghrad, A.M., 2014. Factors affecting medical service quality. Iranian Journal of Public Health43, 2, 210-220.
[65] Niyas, M., Karimi, M., Kavosi, Z., 2018. Utilization of primary health care services in rural and urban areas in Shiraz. Shiraz E Medical Journal19, 10, e66219.
[66] Nuñez‐Perez, N., Ortíz‐Barrios, M., McClean, S., Salas‐Navarro, K., Jimenez‐Delgado, G., Castillo‐Zea, A., (2017). Discrete‐event simulation to reduce waiting time in accident and emergency departments: a case study in a district general clinic. In Ochoa, S. (ed.), Singh, P. (ed.), Bravo, J. (ed.) (eds) International Conference on Ubiquitous Computing and Ambient Intelligence. Springer, Cham, pp. 352-363.
[67] Ocampo, L., Deiparine, C.B., Go, A.L., 2020. Mapping strategy to best practices for sustainable food manufacturing using fuzzy DEMATEL‐ANP‐TOPSIS. Engineering Management Journal32, 130-150.
[68] Ortiz‐Barrios, M., Cabarcas‐Reyes, J., Ishizaka, A., Barbati, M., Jaramillo‐Rueda, N., deJesúsCarrascal‐Zambrano, G., 2020a. A hybrid fuzzy multi‐criteria decision making model for selecting a sustainable supplier of forklift filters: a case study from the mining industry. Annals of Operations Research1-39. https://doi.org/10.1007/s10479-020-03737-y. · Zbl 1481.90205 · doi:10.1007/s10479-020-03737-y
[69] Ortíz‐Barrios, M., Jimenez‐Delgado, G., De Avila‐Villalobos, J., 2017c. A computer simulation approach to reduce appointment lead‐time in outpatient perinatology departments: a case study in a maternal‐child hospital. In Siuly, S. (ed.), Huang, Z. (ed.), Aickelin, U. (ed.), Zhou, R. (ed.), Wang, H. (ed.), Zhang, Y. (ed.), Klimenko, S. (ed.) (eds) International Conference on Health Information Science. Springer, Cham, pp. 32-39.
[70] Ortíz‐Barrios, M., López‐Meza, P., Jimenez‐Delgado, G., 2017b. Applying computer simulation modelling to minimizing appointment lead‐time in elderly outpatient clinics: a case study. In Ochoa, S. (ed.), Singh, P. (ed.), Bravo, J. (ed.) (eds) International Conference on Ubiquitous Computing and Ambient Intelligence, Springer, Cham, pp. 323-329.
[71] Ortíz‐Barrios, M., Miranda‐De la Hoz, C., López‐Meza, P., Petrillo, A., De Felice, F., 2020b. A case of food supply chain management with AHP, DEMATEL, and TOPSIS. Journal of Multi‐Criteria Decision Analysis27, 1-2, 104-128.
[72] Ortíz‐Barrios, M.A., Herrera‐Fontalvo, Z., Rúa‐Muñoz, J., Ojeda‐Gutiérrez, S., De Felice, F., Petrillo, A., 2018, An integrated approach to evaluate the risk of adverse events in hospital sector: From theory to practice. Management Decision56, 10, 2187-2224.
[73] Ortíz‐Barrios, M.A., Kucukaltan, B., Carvajal‐Tinoco, D., Neira‐Rodado, D., Jiménez, G., 2017a. Strategic hybrid approach for selecting suppliers of high‐density polyethylene. Journal of Multi‐Criteria Decision Analysis24, 5-6, 296-316.
[74] Otay, İ., Oztaysi, B., Cevik Onar, S., Kahraman, C., 2017. Multi‐expert performance evaluation of healthcare institutions using an integrated intuitionistic fuzzy AHP and DEA methodology. Knowledge‐Based Systems133, 90-106.
[75] Pereira, M.A., Machete, I.F., Ferreira, D.C., Marques, R.C., 2020. Using multi‐criteria decision analysis to rank European health systems: the Beveridgian financing case. Socio‐Economic Planning Sciences72, 100913.
[76] Phuong, J.M., Penm, J., Chaar, B., Oldfield, L.D., Moles, R., 2019. The impacts of medication shortages on patient outcomes: a scoping review. PloS One14, 5, e0215837.
[77] Polovich, M., (2015). Prevention of errors and patient safety: oncology nurses’ perspectives. In Surbone, A. (ed.), Rowe, M. (ed.) (eds) Clinical oncology and error reduction, John Wiley and Sons, Oxford, pp. 67-86.
[78] Pronovost, P.J., Armstrong, C.M., Demski, R., Peterson, R.R., Rothman, P.B., 2018. Next level of board accountability in health care quality. Journal of Health Organization and Management32, 1, 2-8.
[79] Rahman, M.H., Tumpa, T.J., Ali, S.M., Paul, S.K., 2019. A grey approach to predicting healthcare performance. Measurement134, 307-325.
[80] Rouyendegh, B.D., Oztekin, A., Ekong, J., Dag, A., 2019. Measuring the efficiency of hospitals: a fully‐ranking DEA-FAHP approach. Annals of Operations Research278, 1-2, 361-378. · Zbl 1434.62229
[81] Saaty, T., 1980. The Analytic Hierarchy Process. McGraw‐Hill, New York, NY. · Zbl 1176.90315
[82] Saaty, T.L., 1977. A scaling method for priorities in hierarchical structures. Journal of Mathematical Psychology15, 3, 234-281. · Zbl 0372.62084
[83] Saaty, T.L., 2008. Decision making with the analytic hierarchy process. International Journal of Services Sciences1, 1, 83-98.
[84] Salinas‐Jiménez, J., Smith, P., 1996. Data envelopment analysis applied to quality in primary health care. Annals of Operations Research67, 141-161.
[85] Shafii, M., Rafiei, S., Abooee, F., Bahrami, M.A., Nouhi, M., Lotfi, F., Khanjankhani, K., 2016. Assessment of service quality in teaching hospitals of Yazd University of Medical Sciences: using multi‐criteria decision making techniques. Osong Public Health and Research Perspectives7, 4, 239-247.
[86] Shieh, J., Wu, H., Huang, K., 2010. A DEMATEL method in identifying key success factors of hospital service quality. Knowledge‐Based Systems23, 3, 277-282.
[87] Si, S., You, X., Liu, H., Zhang, P., 2018. DEMATEL technique: a systematic review of the state‐of‐the‐art literature on methodologies and applications. Mathematical Problems in Engineering2018. https://doi.org/10.1155/2018/3696457. · doi:10.1155/2018/3696457
[88] Singh, A., Prasher, A., 2019. Measuring healthcare service quality from patients’ perspective: using fuzzy AHP application. Total Quality Management and Business Excellence30, 3-4, 284-300.
[89] Soysa, I.B., Jayamaha, N.P., Grigg, N.P., 2018. Developing a strategic performance scoring system for healthcare nonprofit organisations. Benchmarking: An International Journal25, 9, 3654-3678.
[90] Torkzad, A., Beheshtinia, M.A., 2019. Evaluating and prioritizing hospital service quality. International Journal of Health Care Quality Assurance32, 2, 332-346.
[91] Tripathi, S.N., Siddiqui, M.H., 2018. Assessing the quality of healthcare services: a SERVQUAL approach. International Journal of Healthcare Management1-12. https://doi.org/10.1080/20479700.2018.1469212. · doi:10.1080/20479700.2018.1469212
[92] Tsai, H., Chang, C., Lin, H., 2010. Fuzzy hierarchy sensitive with Delphi method to evaluate hospital organization performance. Expert Systems with Applications37, 8, 5533-5541.
[93] Twungubumwe, T., Tantchou Dipankui, M., Traoré, L., Ouédraogo, J., Barro, S., Castel, J., Savard, I., Nguebou, M.M., Ramdé, J., Côté, A., Lapierre, J., Ndjaboue, R., Dogba, M.J., 2020. Health professionals and patients’ perspectives on person‐centred maternal and child healthcare in Burkina Faso. PloS One15, 4, e0230340.
[94] Uygun, Ö., Dede, A., 2016. Performance evaluation of green supply chain management using integrated fuzzy multi‐criteria decision making techniques. Computers and Industrial Engineering102, 502-511.
[95] Vinodh, S., Sai Balagi, T.S., Patil, A., 2016. A hybrid MCDM approach for agile concept selection using fuzzy DEMATEL, fuzzy ANP and fuzzy TOPSIS. International Journal of Advanced Manufacturing Technology83, 9-12, 1979-1987.
[96] World Health Organization, 2000. World Health Report 2000: Health Systems: Improving Performance. World Health Organization, Geneva.
[97] World Health Organization, 2008. Operations manual for delivery of hiv prevention, care and treatment at primary health centres in high‐prevalence, resource‐constrained setting. Available at https://www.who.int/hiv/pub/imai/om.pdf (accessed 26 March 2020).
[98] World Health Organization, 2018. World health statistics 2018: monitoring health for the SDGs, sustainable development goals. Available at https://apps.who.int/iris/bitstream/handle/10665/272596/9789241565585-eng.pdf?ua=1 (accessed 26 March 2020).
[99] Zadeh Sarraf, A., Mohaghar, A., Bazargani, H., 2013. Developing TOPSIS method using statistical normalization for selecting knowledge management strategies. Journal of Industrial Engineering and Management6, 4, 860-875.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.