Results of Mathematics Examinations Before, During, and After the Covid-19 Related Restrictions
DOI:
https://doi.org/10.7160/eriesj.2024.170301Keywords:
Covid-19 pandemic, form of examination, mathematics, online exam, statistical evaluation, written testAbstract
The article deals with the results of mathematics examinations at the University of Finance and Administration in Prague before, during, and immediately after the Covid-19 pandemic-related restrictions. The first objective is to evaluate whether the non-standard forms of testing (correspondence and online), used on an emergency basis during the pandemic, were adequate compared to the standard form (face-to-face) applied before the pandemic. The second objective is to assess whether and to what extent the results of the examinations have changed after the return of teaching and testing methods to normal. It turns out that the use of non-standard forms, although more challenging for teachers to control, did not lead to better results – the results in the correspondence form were similar to the standard form and even worse in the online form. The results of examinations administered in the standard form after the return to normal teaching were significantly better than in any of the periods studied, including the standard form of examination before the pandemic. Possible reasons for the results are analysed in the paper.
References
Abdelwahed, N. and Soomro, B. (2023) ‘Attitudes and intentions towards the adoption of mobile learning during COVID-19: building an exciting career through vocational education’, Education and Training, Vol. 65, No. 2, pp. 210–231. https://doi.org/10.1108/ET-02-2022-0048
Ardid, M., Gómez-Tejedor, J. A., Meseguer-Dueñas, J. M., Riera, J. and Vidaurre, A. (2015) ‘Online exams for blended assessment. Study of different application methodologies’, Computers & Education,Vol. 81, pp. 296–303. https://doi.org/10.1016/j.compedu.2014.10.010
Aristovnik, A., Keržič, D., Ravšelj, D., Tomaževič, N. and Umek, L. (2020) ‘Impacts of the COVID-19 Pandemic on Life of Higher Education Students: A Global Perspective’, Sustainability, Vol. 12, No. 20, p. 8438. https://doi.org/10.3390/su12208438
Atoum, Y., Chen, L., Liu, A. X., Hsu, S. D. and Liu, X. (2017) ‘Automated online exam proctoring’, IEEE Transactions on Multimedia, Vol. 19, No. 7, pp. 1609– 1624.
Boevé, A. J., Meijer, R., Albers, C., Beetsma, Y. and Bosker, R. (2015) ‘Introducing computer-based testing in high-stakes exams in Higher Education: Results of a field experiment’, PLoS One, Vol. 10, No. 12, p. e0143616. https://doi.org/10.1371/journal.pone.0143616
Bowman, K. O. and Shenton, L. R. (1975) ‘Omnibus test contours for departures from normality based on √b1 and b2’, Biometrika, Vol. 62, No. 2, pp. 243–250. https://doi.org/10.1093/biomet/62.2.243
Böhmer, C., Feldmann, N. and Ibsen, M. (2018) ‘E-exams in engineering education — online testing of engineering competencies: Experiences and lessons learned’, Proceedings of 2018th IEEE Global Engineering Education Conference (EDUCON), Santa Cruz de Tenerife, pp. 571–576. https://doi.org/10.1109/EDUCON.2018.8363281
Cahapay, M. B. (2020) ‘Rethinking Education in the New Normal Post-COVID-19 Era: A Curriculum Studies Perspective’, Aquademia, Vol. 4, No. 2. https://doi.org/10.29333/aquademia/8315
Cohen, J. (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd Edition, Mahwah: Lawrence Erlbaum Associates.
Darolia, R. (2014) ‘Working (and studying) day and night: Heterogeneous effects of working on the academic performance of full-time and part-time students’, Economics of Education Review, Vol. 38, No. 1, pp. 38–50. https://doi.org/10.1016/j.econedurev.2013.10.004
D’Souza, K. A. and Siegfeldt, D. V. (2017) ‘A Conceptual Framework for Detecting Cheating in Online and Take-Home Exams’, Decision Sciences Journal of Innovative Education, Vol. 15, No. 4, pp. 370–391. https://doi.org/10.1111/dsji.12140
Dvořáková, K., Emmer, J., Janktová, R. and Klementová K. (2021) ‘From F2F to ERT: University Students’ Perception of Remote Learning During the First COVID-19 Lockdown’, Journal on Efficiency and Responsibility in Education and Science, Vol. 14, No. 2, pp. 89–100. http://dx.doi.org/10.7160/eriesj.2021.140203
Elfaki, N. K., Abdulraheem, I. and Abdulrahim, R. (2019) ‘Impact of E-Learning vs Traditional Learning on Student’s Performance and Attitude’, International Journal of Medical Research & Health Sciences, Vol. 8, No. 10, pp. 76–82.
Elsalem, L., Al-Azzam, N., Jum’ah, A. A., Obeidat, N., Sindiani, A. M. and Kheirallah, K. A. (2020) ‘Stress and behavioral changes with remote E-exams during the Covid-19 pandemic: A cross-sectional study among undergraduates of medical sciences’, Annals of Medicine and Surgery, Vol. 60, pp. 271–279. https://doi.org/10.1016/j.amsu.2020.10.058
Fajčíková, A., Fejfarová, M., Hlavsa, T. and Fejfar, J. (2019) ‘Success Rate in Examinations: Does the Degree Programme Matter?’, Proceedings of the 16th International Conference on Efficiency and Responsibility in Education (ERIE 2019), Prague, pp. 43–49.
Fejfar, J., Jadrná, M. and Fejfarová, M. (2021) ‘Covid-19: Distance Learning at FEM CZU Prague from the Perspective of Students (Spring 2020)’, Proceedings of the 18th International Conference on Efficiency and Responsibility in Education (ERIE 2021), Prague, pp. 22–28.
Harmon, O. R. and Lambrinos, J. (2008) ‘Are online exams an invitation to cheat?’, Journal of Economic Education, Vol. 39, No. 2, pp. 116–125. https://doi.org/10.3200/ JECE.39.2.116-125
Hartnett, M., Butler, P. and Rawlins, P. (2023) ‘Online proctored exams and digital inequalities during the pandemic’, Journal of Computer Assisted Learning, Vol. 53, No. 3, pp. 475–490. http://dx.doi.org/10.1111/jcal.12813
Haus, G., Pasquinelli, Y., Scaccia, D. and Scarabottolo, N. (2020) ‘Online written exams during Covid-19 crisis’, Proceedings of International Conference e-Learning 2020, Japan, pp. 79–86.
Ho, N. T. T., Sivapalan, S., Pham, H. H., Nguyen, L. T. M., Pham, A. T. V. and Dinh, H. V. (2021) ‘Students’ adoption of e-learning in emergency situation: the case of a Vietnamese university during COVID-19’, Interactive Technology and Smart Education, Vol. 18, No. 3, pp. 246–269. https://doi.org/10.1108/ITSE-08-2020- 0164
Hvorecký, J., Beňo, M., Ferenčíková, S., Janošcová, R. and Šimúth, J. (2021) ‘Czech and Slovak Educators’ Online Teaching Experience: A Covid-19 Case Study’, Acta Informatica Pragensia, Vol. 10, No. 3, pp. 236–256. http://dx.doi.org/10.18267/j.aip.162
Ilgaz, H. and Adanir, G. A. (2020) ‘Providing online exams for online learners: Does it really matter for them?’, Education and Information Technologies, Vol. 25, No. 2, pp. 1255–1269. https://doi.org/10.1007/s10639-019-10020-6
Itani, Malakeh, Itani, Maher, Kaddoura, S. and Al Husseiny, F. (2022) ‘The impact of the Covid-19 pandemic on online examination: challenges and opportunities’, Global Journal of Engineering Education, Vol. 24, No. 2, pp. 105–120.
Joyce, T., Crockett, S., Jaeger, D. A. (2015) ‘Does classroom time matter?’, Economics of Education Review, Vol. 46, pp. 64–77. https://doi.org/10.1016/j.econedurev.2015.02.007
Kemp, N. and Grieve, R. (2014) ‘Face-to-face or face-to-screen? Undergraduates’ opinions and test performance in classroom vs. online learning’, Frontiers in psychology, Vol. 5. https://doi.org/10.3389/fpsyg.2014.01278
Khan, M. A., Vivek, V., Khojah, M., Nabi, M. K., Paul, M. and Minhaj, S. (2021) ‘Learners’ Perspective towards E-Exams during COVID-19 Outbreak: Evidence from Higher Educational Institutions of India and Saudi Arabia’, International Journal of Environmental Research and Public Health, Vol. 18, No. 12, 6534. https://doi.org/10.3390/ijerph18126534
Klůfa, J. (2021) ‘Evaluation of Oral Exams in Mathematics in Covid Time’, Proceedings of the 18th International Conference on Efficiency and Responsibility in Education (ERIE 2021), Prague, pp. 50–56.
Kyungmee, L. and Fanguy, M. (2022) ‘Online exam proctoring technologies: Educational innovation or deterioration?’, British Journal of Educational Technology, Vol. 53, No. 3, pp. 475–490. https://doi.org/10.1111/bjet.13182
Majovska, R. (2015) ‘Open Source Programmes as the Support in Mathematical Education’, Proceedings of the 12th International Conference on Efficiency and Responsibility in Education (ERIE 2015), Prague, pp. 341–347.
Makamure, C. and Tsakeni, M. (2020) ‘Covid-19 as an Agent of Change in Teaching and Learning STEM Subjects’, Journal of Baltic Science Education, Vol. 19, No. 6A, pp. 1078–1091. https://doi.org/10.33225/jbse/20.19.1078
Mann, H. B. and Whitney, D. R. (1947) ‘On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other’, The Annals of Mathematical Statistics, Vol. 18, No. 1, pp. 50–60.
Mendoza, D., Cejas, M., Rivas, G. and Varguillas, C. (2021) ‘Anxiety as a prevailing factor of performance of university mathematics students during the COVID-19 pandemic’, The Education and Science Journal, Vol. 23, No. 2, pp. 94–113. https://doi.org/10.17853/1994-5639-2021-2-94-113
Moravec L., Ječmínek J. and Kukalová G. (2022) ‘Evaluation of final examination performance at Czech University of Life Sciences during the COVID-19 outbreak’, Journal on Efficiency and Responsibility in Education and Science, Vol. 15, No. 1, pp. 47–52. http://dx.doi.org/10.7160/eriesj.2022.150105
Otavová, M. and Sýkorová, I. (2021) ‘Comparison of Student Results before and during Covid-19 Pandemic’, Proceedings of the 18th International Conference on Efficiency and Responsibility in Education (ERIE 2021), Prague, pp. 98–104.
Pasáčková, J. (2021) ‘Evaluation of Test Results during online and Face-to-Face Learning’, Proceedings of the 18th International Conference on Efficiency and Responsibility in Education (ERIE 2021), Prague, pp. 105–111.
Pokorny, M. (2021) ‘Video Lessons and E-learning Can Overcome Ban of Face-to-face Lessons in Teaching Mathematics’, Proceedings of International Symposium on Educational Technology (ISET 2021), Japan, pp. 44–47. https://doi.org/10.1109/ISET52350.2021.00019
Rahmani, A. M., Mohammadi, M., Rashidi, S., Lánský, J., Mildeová, S., Safkhani, M., Kumari, S. and Hosseinzadeh, M. (2021) ‘Questioning the Security of Three Recent Authentication and Key Agreement Protocols’, IEEE Access, Vol. 9, pp. 98204–98217. http://dx.doi.org/10.1109/ACCESS.2021.3094875
Sun, P.-C., Tsai, R. J., Finger, G., Chen, Y.-Y. and Yeh, D. (2008) ‘What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction’, Computers & Education, Vol. 50, No. 4, pp. 1183–1202. https://doi.org/10.1016/j.compedu.2006.11.007
Thompson, V. L. and McDowell, Y. L. (2019) ‘A Case Study Comparing Student Experiences and Success in an Undergraduate Mathematics Course offered through Online, Blended, and Face-to-Face Instruction’, International Journal of Education in Mathematics, Science and Technology (IJEMST), Vol. 7, No. 2, pp. 116–136. http://dx.doi.org/10.18404/ijemst.552411
Ulrychová, E. and Bílková, D. (2018) ‘Gender Analysis of Math Exam Results at University of Finance and Administration’, Proceedings of the 12th International Days of Statistics and Economics (MSED), Prague, pp. 1815–1822.
Ulrychová, E., Majovská, R. and Tesař, P. (2022) ‘Standard Form vs. Two Alternative Forms of Written Examinations in Mathematics’, Proceedings of the 19th International Conference on Efficiency and Responsibility in Education (ERIE 2022), Prague, pp. 165–176.
Waheeb, Y., Manoranjan, M. and Basem, S. (2022) ‘Privacy-Preserving Online Proctoring using Image-Hashing Anomaly Detection’, Proceedings of EEE International Wireless Communications and Mobile Computing (IWCMC 2022), Dubrovnik, pp. 1113–1118, https://doi.org/10.1109/IWCMC55113.2022.9825119
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Eva Ulrychová, Renata Majovská, Petr Tesař
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
