Measuring the Efficiency of Turkish Research Universities via Two-Stage Network DEA with Shared Inputs Model
DOI:
https://doi.org/10.7160/eriesj.2023.160406Keywords:
Network DEA, research efficiency, regional development, shared inputs, Turkish research universities, teaching efficiencyAbstract
The efficiency of universities, which have a network structure of production process, is an essential component of performance measurement in education. However, most previous studies use traditional Data Envelopment Analysis (DEA), which disregards the network structure of the production process in universities. This study adopts a two-stage Network Data Envelopment Analysis (NDEA) with shared inputs model to assess the overall, teaching and research efficiencies of Turkish research universities. The findings show that only 6 out of 23 research universities are efficient, and some universities with lower world rankings are more efficient than those with higher rankings. On the other hand, no significant difference was found between the efficiency levels of regions with a high level of socio-economic development and regions with a relatively low level of socio-economic development. The study also evaluates the effects of different priority scenarios on efficiency and the optimal allocation of shared inputs between sub-processes. This study provides guidance for universities seeking to improve their performance and for the Council of Higher Education (CHE) in determining incentives for research universities. It also promotes the use of multi-stage NDEA with shared inputs model over traditional DEA for accurate efficiency assessment in the field of education.
References
Abbott, M., and Doucouliagos, C. (2003) ‘The Efficiency of Australian Universities: A Data Envelopment Analysis’, Economics of Education Review, Vol. 22, No. 1, pp. 89–97. https://doi.org/10.1016/S0272-7757(01)00068-1
Agasisti, T., Dal Bianco, A., Landoni, P., Sala, A. and Salerno, M. (2011) ‘Evaluating the Efficiency of Research in Academic Departments: An Empirical Analysis in an Italian Region’, Higher Education Quarterly, Vol. 65, No. 3, pp. 267–289. https://doi.org/10.1111/j.1468-2273.2011.00489.x
Altbach, P. G. (2011) ‘The Past, Present, and Future of the Research University’, Economic and Political Weekly, Vol. 46, No. 16, pp. 65–73.
Altbach, P. G. and Salmi, J. (2011) The road to academic excellence: The making of world-class research universities, Washington, DC: World Bank Publications.
Altbach, P. G. (2015) ‘What Counts for Academic Productivity in Research Universities?’, International Higher Education, No. 79, pp. 6–7. https://doi.org/10.6017/ihe.2015.79.5837
Arbo, P. and P. Benneworth (2007) Understanding the Regional Contribution of Higher Education Institutions: A Literature Review, OECD Education Working Papers, No. 9, OECD Publishing, Paris. https://doi.org/10.1787/161208155312
Avkiran, N. K. (2001) ‘Investigating Technical and Scale Efficiencies of Australian Universities through Data Envelopment Analysis’, Socio-Economic Planning Sciences, Vol. 35, No. 1, pp. 57–80. https://doi.org/10.1016/S0038-0121(00)00010-0
Banker, R. D., Charnes, A. and Cooper, W. W. (1984) ‘Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis’, Management Science, Vol. 30, No. 9, pp. 1078–1092. http://dx.doi.org/10.1287/mnsc.30.9.1078
Chankseliani, M., Qoraboyev, I. and Gimranova, D. (2021) ‘Higher Education Contributing to Local, National, and Global Development: New Empirical and Conceptual Insights’, Higher Education, Vol. 81, pp. 109–127. https://doi.org/10.1007/s10734-020-00565-8
Charnes, A., Cooper, W. W. and Rhodes, E. (1978) ‘Measuring the Efficiency of Decision Making Units’, European Journal of Operational Research, Vol. 2, No. 6, pp. 429–444. https://doi.org/10.1016/0377-2217(78)90138-8
CHE (2020) Yükseköğretimde İhtisaslaşma ve Misyon Farklılaşması: Araştırma Üniversiteleri [Specialisation and Mission Differentiation in Higher Education: Research Universities], [Online], Available: https://www.yok.gov.tr/Documents/Yayinlar/Yayinlarimiz/2020/misyon-faklilasmasi-ve-ihtisaslasma-arastirma-universiteleri.pdf [12 Jun 2023].
CHE (2021) YÖK Başkanı Özvar Araştırma Üniversitelerine Yönelik Yaptıkları Yeni Düzenlemeleri Açıkladı [CHE President Özvar Announced New Regulations for Research Universities], [Online], Available: https://www.yok.gov.tr/Sayfalar/Haberler/2021/arastirma-universiteleri-ile-toplanti.aspx [13 Jun 2023].
CHE (2022) Higher Education Information Management System, [Online], Available: https://istatistik.yok.gov.tr/ [21 Jun 2023].
Chen, Y., Cook, W. D., Li, N. and Zhu, J. (2009) ‘Additive Efficiency Decomposition in two-Stage DEA’ European Journal of Operational Research, Vol. 196, No. 3, pp. 1170-1176. https://doi.org/10.1016/j.ejor.2008.05.011
Chen, Y., Du, J., David Sherman, H. and Zhu, J. (2010) ‘DEA Model with Shared Resources and Efficiency Decomposition’, European Journal of Operational Research, Vol. 207, No. 1, pp. 339–349. https://doi.org/10.1016/j.ejor.2010.03.031
Chen, Y., Ma, X., Yan, P., & Wang, M. (2021) ‘Operating Efficiency in Chinese Universities: An Extended two-stage Network DEA Approach’, Journal of Management Science and Engineering, Vol. 6, No. 4, pp. 482–498. https://doi.org/10.1016/j.jmse.2021.08.005
Chodakowska, E. (2015) An Example of Network Dea–Assessment of Operating Efficiency of Universities, Metody Ilościowe w Badaniach Ekonomicznych, Vol. 16, No. 1, pp. 75–84, [Online], Available: https://qme.sggw.edu.pl/article/view/3753 [05 Jun 2023].
Cinar, Y. (2016) Research and Teaching Efficiencies of Turkish Universities with Heterogeneity Considerations: Application of Multi-Activity DEA and DEA by Sequential Exclusion of Alternatives Methods (Moscow National Research University Higher School of Economics, Working Papers No. WP7/2013/04), [Online], Available: https://arxiv.org/ftp/arxiv/papers/1701/1701.07318.pdf [02 Jun 2023].
Cook, W. D. and Hababou, M. (2001) ‘Sales Performance Measurement in Bank Branches’, Omega, Vol. 29, No. 4, pp. 299–307. https://doi.org/10.1016/S0305-0483(01)00025-1
Cook, W. D., Liang, L. and Zhu, J. (2010) ‘Measuring Performance of two-stage Network Structures by DEA: A Review and Future Perspective’, Omega, Vol 38, No. 6, pp. 423–430. https://doi.org/10.1016/j.omega.2009.12.001
Cooper, W. W., Seiford, L. M. and Tone, K. (2007) Data envelopment analysis: a comprehensive text with models, applications, references and DEA-solver software, New York: Springer.
Cui, Z. and Li, E. (2022) ‘Does Industry-University-Research Cooperation Matter? An Analysis of Its Coupling Effect on Regional Innovation and Economic Development’, Chinese Geographical Science, Vol. 32, No. 5, pp. 915–930.
Çağlar, M. and Gürler, C. (2020) ‘Measuring the Efficiency of Research and Candidate Research Universities in Turkey using Data Envelopment Analysis’, The Journal of International Scientific Researches, Vol. 5, No. 2, pp. 143–157. https://doi.org/10.23834/isrjournal.729591
Daft, R. L. (2015) Organization theory and design, USA: Cengage Learning Publications.
Development Agencies (2023) Kalkınma Planlamasında İstatistiki Bölge Birimleri Sınıflandırması [Classification of Statistical Regional Units in Development Planning], [Online], Available: https://ka.gov.tr/sayfalar/kalkinma-planlamasinda-istatistiki-bolge-birimleri-siniflandirmasi--24 [02 Oct 2023].
Ding, T., Yang, J., Wu, H., Wen, Y., Tan, C. and Liang, L. (2021) ‘Research Performance Evaluation of Chinese University: A Non-Homogeneous Network DEA Approach’, Journal of Management Science and Engineering, Vol. 6, No. 4, pp. 467–481. https://doi.org/10.1016/j.jmse.2020.10.003
Doğan, H. (2018) ‘Measurement of Relative Efficiency of the Department of Business in Turkey in terms of Success in Public Personnel Selection Examination’, Proceedings of the 2nd International Conference on Awareness, Turkey, pp. 1043–1050.
Egorov, A. and Serebrennikov, P. (2023) ‘Measuring The Efficiency of Universities: What is Inside the Black Box?’, Journal of Higher Education Policy and Management, Vol. 45, No. 5, pp. 545–565. https://doi.org/10.1080/1360080X.2023.2209379
Erdem, A. R. (2013) ‘Changing Roles and Missions of University in Information Society’, Yükseköğretim Dergisi, Vol. 3, No. 2, pp. 109–120.
Erdoğan M. and Karagöl V. (2018) ‘The Role of Newly Established Universities in Regional Development: The Case of Bingöl’, International Journal of Economics, Business and Politics, Vol. 2, No. 1, pp. 51–78. https://doi.org/10.29216/ueip.397494
Erdoğmuş, N. and Esen, M. (2016) ‘Classifying Universities in Turkey by Hierarchical Cluster Analysis’, Education and Science, Vol. 41, No. 184, pp. 363–382. http://dx.doi.org/10.15390/EB.2016.6232
Färe, R. and Grosskopf, S. (1996) ‘Productivity and Intermediate Products: A Frontier Approach’, Economics Letters, Vol. 50, No. 1, pp. 65–70. https://doi.org/10.1016/0165-1765(95)00729-6
Färe, R. and Grosskopf, S. (2000) ‘Network DEA’, Socio-Economic Planning Sciences, Vol. 34, No. 1, pp. 35–49. https://doi.org/10.1016/S0038-0121(99)00012-9
Färe, R., Grosskopf, S. and Whittaker, G. (2007) ‘Network DEA’, in J. Zhu & W. D. Cook (Eds.), Modeling Data Irregularities and Structural Complexities in Data Envelopment Analysis (pp. 209–240), Boston, MA: Springer US.
Findler, F., Schönherr, N., Lozano, R., Reider, D. and Martinuzzi, A. (2019) ‘The Impacts of Higher Education Institutions on Sustainable Development: A Review and Conceptualization’, International Journal of Sustainability in Higher Education, Vol. 20, No. 1, pp. 23–38. https://doi.org/10.1108/IJSHE-07-2017-0114
Flégl, M., Tichá, I. and Stanislavská, L. K. (2013) ‘Innovation of Doctoral Studies at the FEM CULS Prague’, Journal on Efficiency and Responsibility in Education and Science, Vol. 6, No. 4, pp. 265–280. https://doi.org/10.7160/eriesj.2013.060405
Geuna, A. and Muscio, A. (2009) ‘The Governance of University Knowledge Transfer: A Critical Review of The Literature’, Minerva, Vol. 47, pp. 93–114. https://doi.org/10.1007/s11024-009-9118-2
Goldstein, H. and Renault, C. (2004) ‘Contributions of Universities to Regional Economic Development: A Quasi-Experimental Approach’, Regional Studies, Vol. 38, No. 7, pp. 733–746. https://doi.org/10.1080/0034340042000265232
Halásková R., Mikušová Meričková B. and Halásková M. (2022) ‘Efficiency of Public and Private Service Delivery: The Case of Secondary Education’, Journal on Efficiency and Responsibility in Education and Science, Vol. 15, No. 1, pp. 33–46. http://dx.doi.org/10.7160/eriesj.2022.150104
Işık, Ş. and Başaran, E. (2021) ‘The Impact of the University on the Population Structure of the City: The Case of Gümüşhane City’, Aegean Geographical Journal, Vol. 30, No. 2, pp. 359–382. https://doi.org/10.51800/ecd.1018483
Jauhar, S. K., Pant, M. and Dutt, R. (2018) ‘Performance Measurement of An Indian Higher Education Institute: A Sustainable Educational Supply Chain Management Perspective’, International Journal of System Assurance Engineering and Management, Vol. 9, No. 1, pp. 180–193. https://doi.org/10.1007/s13198-016-0505-4
Johnes, J. and Johnes, G. (1995) ‘Research Funding and Performance in U.K. University Departments Of Economics: A Frontier Analysis’, Economics of Education Review, Vol. 14, No. 3, pp. 301–314. https://doi.org/10.1016/0272-7757(95)00008-8
Kao, C. (2014) ‘Network Data Envelopment Analysis: A Review’, European Journal of Operational Research, Vol. 239, No. 1, pp. 1–16. https://doi.org/10.1016/j.ejor.2014.02.039
Kao, C. and Hwang, S.-N. (2008) ‘Efficiency Decomposition in Two-Stage Data Envelopment Analysis: An Application to non-Life Insurance Companies in Taiwan’, European Journal of Operational Research, Vol. 185, No. 1, pp. 418–429. https://doi.org/10.1016/j.ejor.2006.11.041
Kempkes, G. and Pohl, C. (2010) ‘The Efficiency of German Universities–Some Evidence from Nonparametric and Parametric Methods’, Applied Economics, Vol. 42, No. 16, pp. 2063–2079. https://doi.org/10.1080/00036840701765361
Koçak, E. and Örkçü, H. H. (2021) ‘Measuring the Efficiency of Turkish State Universities Based on a Two-Stage DEA Model’, Gazi University Journal of Science, Vol. 34, No. 4, pp. 1210–1220. https://doi.org/10.35378/gujs.801115
Kupriyanova, V., Estermann, T. and Sabic, N. (2018) ‘Efficiency of Universities: Drivers, Enablers and Limitations’, in Curaj, A., Deca, L. and Pricopie, R. (eds.) European Higher Education Area: The Impact of Past and Future Policies, Springer, Cham, pp. 603–618. https://doi.org/10.1007/978-3-319-77407-7_36
Lee, B. L. and Worthington, A. C. (2016) ‘A Network DEA Quantity And Quality-Orientated Production Model: An Application to Australian University Research Services’, Omega, Vol. 60, pp. 26–33. https://doi.org/10.1016/j.omega.2015.05.014
Lewis, H. F. and Sexton, T. R. (2004) ‘Network DEA: Efficiency Analysis of Organizations With Complex Internal Structure’, Computers & Operations Research, Vol. 31, No. 9, pp. 1365–1410. https://doi.org/10.1016/S0305-0548(03)00095-9
Liang, L., Cook, W. D. and Zhu, J. (2008) ‘DEA Models for two-Stage Processes: Game Approach and Efficiency Decomposition’, Naval Research Logistics, Vol. 55, No. 7, pp. 643–653. https://doi.org/10.1002/nav.20308
Lindsay, A. W. (1982) ‘Institutional Performance in Higher Education: The Efficiency Dimension’, Review of Educational Research, Vol. 52, No. 2, pp. 175–199. https://doi.org/10.3102/00346543052002175
Liu, J. S., Lu, L. Y. Y., Lu, W.-M. and Lin, B. J. Y. (2013) ‘A Survey of DEA Applications’, Omega, Vol. 41, No. 5, pp. 893–902. https://doi.org/10.1016/j.omega.2012.11.004
Lu, W.-M. (2012) ‘Intellectual Capital and University Performance in Taiwan’, Economic Modelling, Vol. 29 No. 4, pp. 1081–1089. https://doi.org/10.1016/j.econmod.2012.03.021
Mammadov, R. and Aypay, A. (2020) ‘Efficiency Analysis of Research Universities in Turkey’, International Journal of Educational Development, Vol 75, 102176. https://doi.org/10.1016/j.ijedudev.2020.102176
Mikušová, P. (2017) ‘Measuring the Efficiency of the Czech Public Higher Education Institutions: An Application of DEA’, Journal on Efficiency and Responsibility in Education and Science, Vol. 10, No. 2, pp. 58–63. https://doi.org/10.7160/eriesj.2017.100204
Nazarko, J. and Šaparauskas, J. (2014) ‘Application of DEA Method in Efficiency Evaluation of Public Higher Education Institutions’, Technological and Economic Development of Economy, Vol. 20, No. 1, pp. 25–44. https://doi.org/10.3846/20294913.2014.837116
Özel, G. (2014) ‘Efficiency Analysis of State Universities: A Case of Turkey’, Hacettepe University Journal of Education, Vol. 29, No. 3, pp. 124–136.
Parilla, J. and Haskins, G. (2023) How Research Universities Are Evolving to Strengthen Regional Economies (Brookings Institution, Commentary), [Online], Available: https://www.brookings.edu/articles/how-research-universities-are-evolving-to-strengthen-regional-economies/ [02 Jun 2023].
Saniee Monfared, M. A. and Safi, M. (2013) ‘Network DEA: An Application to Analysis of Academic Performance’, Journal of Industrial Engineering International, Vol. 9, 15. https://doi.org/10.1186/2251-712X-9-15
SEGE (2019) İllerin ve Bölgelerin Sosyo-Ekonomik Gelişmişlik Sıralaması Araştırması SEGE 2017 [Socio-Economic Development Ranking Research of Provinces and Regions], [Online], Available: https://www.sanayi.gov.tr/merkez-birimi/b94224510b7b/sege/il-sege-raporlari [10 Sep 2023].
Shamohammadi, M. and Oh, D.-h. (2019) ‘Measuring the Efficiency Changes of Private Universities of Korea: A two-Stage Network Data Envelopment Analysis’, Technological Forecasting and Social Change, No. 148, 119730. https://doi.org/10.1016/j.techfore.2019.119730
Smith, H. L. and Bagchi-Sen, S. (2012) ‘The Research University, Entrepreneurship and Regional Development: Research Propositions and Current Evidence’, Entrepreneurship & Regional Development, Vol. 24, No. 5-6, pp. 383–404. https://doi.org/10.1080/08985626.2011.592547
TAÜG (2016) Araştırma Üniversiteleri ve Yükseköğretim, Araştırma ve İnovasyonda Uluslararası Rekabet Raporu [Research Universities and Higher Education, International Competitiveness in Research and Innovation Report], [Online], Available: https://pdo.metu.edu.tr/system/files/duyuru/TAUG_Arastirma_Universiteleri_ve_Yuksekogretim_Arastirma_ve_Inovasyonda_Uluslararasi_Rekabet_Raporu_2016.pdf [10 Sep 2023].
Tavares, R. S., Angulo-Meza, L. and Sant'Anna, A. P. (2021) ‘A Proposed Multistage Evaluation Approach for Higher Education Institutions Based on Network Data Envelopment Analysis: A Brazilian Experience’, Evaluation and Program Planning, Vol. 89, 101984. https://doi.org/10.1016/j.evalprogplan.2021.101984
Tomkins, C. and Green, R. (1988) ‘An Experiment in the Use of Data Envelopment Analysis for Evaluating the Efficiency of UK University Departments of Accounting’, Financial Accountability & Management, Vol. 4, No. 2, pp. 147–164. https://doi.org/10.1111/j.1468-0408.1988.tb00296.x
URAP (2021) 2020–2021 URAP Dünya Sıralaması [2020–2021 URAP World Rankings], [Online], Available: https://newtr.urapcenter.org/cdn/storage/PDFs/sA6knxSyqokQy5YfA/original/sA6knxSyqokQy5YfA.pdf [10 Sep 2023].
Yang, G.-l., Fukuyama, H. and Song, Y.-y. (2018) ‘Measuring the Inefficiency of Chinese Research Universities based on a two-stage Network DEA Model’, Journal of Informetrics, Vol. 12, No. 1, pp. 10–30. https://doi.org/10.1016/j.joi.2017.11.002
Yavuzçehre, P. S. (2016) ‘The Effects of Universities on Their Cities: The Case of Denizli Pamukkale University’, Suleyman Demirel University The Journal of Faculty of Economics and Administrative Sciences, Vol. 21, No. 1, pp. 235–250.
Zinchenko, D. and Egorov, A. (2019) ‘Efficiency Modeling of Russian Universities’, HSE Economic Journal, Vol. 23, No. 1, pp. 143–172. https://doi.org/10.17323/1813-8691-2019-23-1-143-172
Additional Files
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2023 Hamza Dogan
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
