On the Problem of Generating a Large Number of Comparable Test Variants

Authors

  • Mikuláš Gangur University of West Bohemia in Pilsen, faculty of Economics
  • Miroslav Plevný University of West Bohemia in Pilsen, faculty of Economics

DOI:

https://doi.org/10.7160/eriesj.2018.110402

Keywords:

automatic test generation, combinatorial explosion, evaluation methodologies, XSL transformation

Abstract

The paper presents a possible way of solving the problem of creating more test variants for a large number of students divided into groups. The proposed solution may consist in introducing a parameterized automatic test generator. The principle of an automatic parameterized test generator is shown. The process of the question tree construction according to the increasing numbers of questions in the banks of the particular subjects leads to a combinatorial explosion. This often results in the excessive time of generation of the different variants of tests. To solve this problem, a heuristic method based on a pre-processing stage that precedes the construction of the searching tree is proposed. Further, the results of the experiments comparing the time of the test generation and the congruence of the test variants generated by the algorithm either using or non-using this heuristics are presented. According to these results, the use of the generator with the proposed heuristics provides a considerably shorter time of generation, and the congruence of the generated test variants is even better in most cases.

References

  • Aiken (2013) MoodleDocs: Aiken format. [Online], Available: http://docs.moodle.org/22/en/Aiken_format [26 Jul 2016].

  • Brusilovsky, P. and Pathak, S. (2002) ‘Assessing Student Programming Knowledge with Web-based Dynamic Parameterized Quizzes’. Association for the Advancement of Computing in Education (AACE), pp. 1548-1553.

  • Fakhrusy, M.R. and Widyani, Y. (2017) ‘Moodle plugins for quiz generation using genetic algorithm’. 2017 International Conference on Data and Software Engineering (ICoDSE) Palembang, Indonesia, INSPEC Accession Number: 17578381. http://dx.doi.org/10.1109/ICODSE.2017.8285882

  • Foltýnek, T. (2009) ‘A New Approach to the Achievement Test Items Evaluation: the Correctness Coefficients’. Journal on Efficiency and Responsibility in Education and Science, vol. 2, no. 1, pp. 28-40.

  • Gangur, M. (2011) ‘Automatic generation of cloze questions’. CSEDU 2011 - Proceedings of the 3rd International Conference on Computer Supported Education, Portugal, SciTePress - Science and Technology Publications, pp. 264-269.

  • Gangur, M. (2014) ‘Automatic Parameterized Generation of Test’. DIVAI 2014: 10th International Scientific Conference on Distance Learning in Applied Informatics. Prague, Wolters Kluwer, pp. 55-64.

  • Gladavská, L. and Plevný, M. (2014) ‘Problems of automatic generation of questions for the purpose of testing the knowledge in a management science course’. DIVAI 2014: 10th International Scientific Conference on Distance Learning in Applied Informatics. Prague, Wolters Kluwer, pp. 325-335.

  • Hürst, W., Jung, S. and Welte, M. (2007) ‘Effective learn-quiz generation for handheld devices’. Proceedings of the 9th international conference on Human computer interaction with mobile devices and services, ACM, pp. 364-366.

  • Kapusta, J., Munk, M. and Turčáni, M. (2010) ‘Evaluation of adaptive techniques dependent on educational content’. 4th International Conference on Application of Information and Communication Technologies, AICT2010, INSPEC Accession Number:  5611791. http://dx.doi.org/10.1109/ICAICT.2010.5611791

  • Klůfa, J. and Kaspříková, N. (2012) ‘Multiple Choice Question Tests for Entrance Examinations - A Probabilistic Approach’. Journal on Efficiency and Responsibility in Education and Science, vol. 5, no. 4, pp. 195-202. http://dx.doi.org/10.7160/eriesj.2012.050402

  • Klůfa J. (2016) ‘Comparison of the Test Variants in Entrance Examinations’. Journal on Efficiency and Responsibility in Education and Science, vol. 9, no. 4, pp. 111-116, http://dx.doi.org/10.7160/eriesj.2016.090404

  • Kosek, J. (2013) XML for everyone. [Online], Available: http://www.kosek.cz/xml/index.html [20 May 2016].

  • Mine, T., Shoudai, T. and Suganuma, A. (2000) ‘Automatic Exercise Generator with Tagged Documents Considering Learner’s Performance’. Association for the Advancement of Computing in Education (AACE), Chesapeake, VA, pp. 779-780.

  • Niazi, R. and Mahmoud, Q.H. (2000) ‘A Web-based Tool for Generating Quizzes for Mobile Devices’. A poster at the 39th ACM Technical Symposium on Computer Science Education (SIGCSE). Portland, OR.

  • Nuthong, S. and Witosurapot, S. (2017) ‘Enabling fine granularity of difficulty ranking measure for automatic quiz generation’. 9th International Conference on Information Technology and Electrical Engineering (ICITEE), Phuket, Thailand, pp. 1-6. http://dx.doi.org/10.1109/ICITEED.2017.8250492

  • Rosman, P. and Buřita, L. (2014) ‘Concept of the computer science course and some aspects of ICT integration into education’. E&M Ekonomie a management, vol. 17, no. 3, pp. 169-180. http://dx.doi.org/10.15240/tul/001/2014-3-013

  • Sung, L.-C., Lin, Y.-C. and Chen, M.C. (2007) ‘An Automatic Quiz Generation System for English Text’. 7th IEEE International Conference on Advanced Learning Technologies, Proceedings, Niigata, Japan, INSPEC Accession Number: 9868711. http://dx.doi.org/10.1109/ICALT.2007.56

  • Tomas, A.P. and Leal, J.P. (2013) ‘Automatic generation and delivery of multiple-choice math quizzes’. Principles and Practice of Constraint Programming. CP 2013. Lecture Notes in Computer Science, Vol. 8124. Springer, Berlin, Heidelberg, pp. 848-863. http://dx.doi.org/10.1007/978-3-642-40627-0_62

  • Yang, A., Wu, J. and Wang, L. (2008) ‘Research and design of test question database management system based on the three-tier structure’. WSEAS Transactions on Systems, vol. 7, no. 12, pp. 1473-1483.

  • Zeng, J., Sakai, T., Yin, C., Suzuki, T. and Hirokawa, S. (2013). ‘Automatic generation of tourism quiz using blogs’. Artificial Life and Robotics, vol. 17, no. 3-4, pp. 412-416. http://dx.doi.org/10.1007/s10015-012-0076-7

    • Additional Files

    Published

    2019-01-09

    How to Cite

    Gangur, M. and Plevný, M. (2019) ’On the Problem of Generating a Large Number of Comparable Test Variants’, Journal on Efficiency and Responsibility in Education and Science, vol. 11, no. 4, pp. 78–84. https://doi.org/10.7160/eriesj.2018.110402

    Issue

    Vol. 11 No. 4 (2018)

    Section

    Research Paper

    License

    Authors declare with this manuscript intended for publication to ERIES Journal that:

    • all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
    • all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
    • no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
    • the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
    • submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
    • experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
    • grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.

    Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.