Development of Models, Methods, and Algorithms for An Auto-Mated Rating System in Professional Education
DOI:
https://doi.org/10.14419/83h3xh17Keywords:
Assessment Efficiency; Data Analysis; Indicator Normalisation; Information Processing; Quality of EducationAbstract
This study aims to develop tools for constructing an automated rating system to objectively assess vocational education quality in the Kyrgyz Republic. It led to the creation of a conceptual model for an automated rating system, identification of key evaluation criteria, and development of a framework for component interaction. Methods for automated data collection were developed, including database integration via a software interface, electronic questionnaires, and web scraping. Processes for data cleaning, normalisation, and weighting were established to prepare information for analysis. Algorithms were implemented to integrate quantitative and qualitative indicators in assessing educational institutions' performance. The conceptual model reflects the specific features of vocational education and the regional environment. Key methods include data cleaning, normalisation, assigning weights to criteria, and analysing institutional effectiveness. Algorithms for automated data collection via software interfaces and web scraping ensure access to up-to-date information from educational portals. Prohierarchycessing algorithms, such as data cleaning and normalisation, ensure high-quality data preparation. Quality assessment algorithms, based on hierar-chy analysis and efficiency evaluation methods, objectively incorporate qualitative and quantitative indicators like teaching quality, student performance, scientific publications, and material resources.
References
- Aida-zade K, Ismibayli R & Rzayeva S 2024. Automated schedule system for universities under the Bologna education process. Cybernetics and Computer Technologies, 1, 75–90. https://doi.org/10.34229/2707-451X.24.1.6
- Akhatov AR, Mardonov DR, Nurmamatov MQ & Nazarov FM 2021. Improvement of mathematical models of the rating point system of employ-ment. Scientific Journal, 1(125), 100–107. https://doi.org/10.59251/2181-1296.v1.1251.714
- Amelina S & Tarasenko R 2024. Dual form of education: The experience of german higher education institutions. Humanities Studios: Pedagogy, Psychology, Philosophy, 12(2), 8-14. https://doi.org/10.31548/hspedagog15(2).2024.8-14
- Ananth C, Akhatov AR, Mardonov D, Nazarov FM & Ananth Kumar T 2022. Possible models and algorithms for the intellectual system of profes-sional direction. International Journal of Early Childhood Special Education, 14(5), 4133–4145.
- Aydın-Karaca Ş & Kılınç Ş 2024. Development of a teacher rating scale for giftedness (TRSG). Acta Educationis Generalis, 14(2), 100–117. https://doi.org/10.2478/atd-2024-0014
- Baral S, Worden E, Lim WC, Luo Z, Santorelli C, Gurung A & Heffernan NT 2024. Automated feedback in math education: A comparative analy-sis of LLMs for open-ended responses. https://doi.org/10.48550/arXiv.2411.08910
- Bendo A, Brovina F, Bushati S, Sallaku D, Bushati M & Papa E 2025. The Effect of High Interval Intensity Training (HIIT) on the Performance of Basketball Players 10-15 Years Old. Retos, 62, 627–636. https://doi.org/10.47197/retos.v62.109315
- Bezshyyko O, Dolinskii A, Bezshyyko K, Kadenko I, Yermolenko R & Ziemann V 2008. PETAG01: A program for the direct simulation of a pel-let target. Computer Physics Communications, 178(2), 144–155. https://doi.org/10.1016/j.cpc.2007.07.013
- Bisenovna KA, Ashatuly SA, Beibutovna LZ, Yesilbayuly KS, Zagievna AA, Galymbekovna MZ & Oralkhanuly OB 2024. Improving the effi-ciency of food supplies for a trading company based on an artificial neural network. International Journal of Electrical and Computer Engineering, 14(4), 4407–4417. https://doi.org/10.11591/ijece.v14i4.pp4407-4417
- Chavez JC 2025. Enhancing Flipped Classrooms With Technology-Enhanced Assessments. International Journal of Educational Reform, 10567879251341856. https://doi.org/10.1177/10567879251341856
- Derevianko D & Shovkaliuk M 2023. Formation of the soft skills for students of energy specialties through the implementation of active learning methods into the educational process. Technologies and Engineering, 24(6), 9-20. https://doi.org/10.30857/2786-5371.2023.6.1
- Dimari A, Tyagi N, Davanageri M, Kukreti R, Yadav R & Dimari H 2024. AI-based automated grading systems for open book examination system: Implications for assessment in higher education. In: 2024 International Conference on Knowledge Engineering and Communication Systems, 1259–1265. Red Hook: IEEE. https://doi.org/10.1109/ICKECS61492.2024.10616490
- Dudko S 2024. Modeling of the educational environmentin the teacher’s professional and pedagogical activity. Ukrainian Professional Education, 8(1), 93-100.
- Gao R, Merzdorf HE, Anwar S, Hipwell MC & Srinivasa A 2024. Automatic assessment of text-based responses in post-secondary education: A systematic review. Computers and Education: Artificial Intelligence, 6, 100206. https://doi.org/10.1016/j.caeai.2024.100206
- Gebreyes MT & Abajemal SA 2024. Formative assessment practice and its challenges on trainee’s learning, motivation and academic achievement at Bonga College of Education, Ethiopia. European Journal of Education Studies, 11(11), 371–399. http://dx.doi.org/10.46827/ejes.v11i11.5613
- Gomez CJ, Auger A & Cannon J 2022. Do early care and education programs improve when enrolled in quality rating and improvement systems? Longitudinal evidence from one system. Early Education and Development, 34(5), 1236–1253. https://doi.org/10.1080/10409289.2022.2105624
- Guerra Hahn M, Baldiris Navarro SM, De La Fuente Valentín L & Burgos D 2021. A systematic review of the effects of automatic scoring and automatic feedback in educational settings. IEEE Access, 9(1), 108190–108198. http://doi.org/10.1109/ACCESS.2021.3100890
- Horbatiuk R & Kabak V 2022. Social networks as tools for forming the informational educational environment of a higher education institution. Professional Education: Methodology, Theory and Technologies, 8(1), 92-110. https://doi.org/10.31470/2415-3729-2022-15-92-110
- Karazakova Z & Sheranova N 2023. The significance and role of assessment through the internal rating of the activities of the HEI teaching staff. Bulletin of Osh State University, 1, 68–76. https://doi.org/10.52754/16948610_2023_1_9
- Kerimkhulle S, Kerimkulov Z, Aitkozha Z, Saliyeva A, Taberkhan R & Adalbek A 2023. The Classification of Vegetations Based on Share Reflec-tance at Spectral Bands. Lecture Notes in Networks and Systems, 724, 95–100. https://doi.org/10.1007/978-3-031-35314-7_8
- Kerimkhulle S, Kerimkulov Z, Bakhtiyarov D, Turtayeva N & Kim J 2021. In-Field Crop-Weed Classification Using Remote Sensing and Neural Network. In: SIST 2021 - 2021 IEEE International Conference on Smart Information Systems and Technologies, 9465970. https://doi.org/10.1109/SIST50301.2021.9465970.
- Kozhevnikova A & Kozhevnykov P 2024. Specifics of innovative educational environment and its influence on the development of future teachers’ innovative competence. Scientific Bulletin of Mukachevo State University. Series “Pedagogy and Psychology”, 10(2), 72-80. https://doi.org/10.52534/msu-pp2.2024.72
- Kudaibergenova R & Serikkaliyeva A 2024. Rating indicators as criteria for academic excellence in higher education: Kazakhstani context. Journal of Educational Sciences, 80(3), 74–86. https://doi.org/10.26577/JES2024v80.i3.06
- Kuznietsov Ye & Kuznietsova T 2024. Innovative models of vocational education: A symbiosis of artificial intelligence, neuropedagogy, and the competency-based approach. Professional Education: Methodology, Theory and Technologies, 10(1), 64–78. https://doi.org/10.69587/pemtt/1.2024.64
- Kyshtoobaeva C 2023. The role of computer technologies in improving the quality of students’ education. Bulletin of Osh State University, 3, 51–58. https://doi.org/10.52754/16948610_2023_3_6
- Li A 2023. The construction and application of an automatic scoring system for English writing. Procedia Computer Science, 228, 872–881. https://doi.org/10.1016/j.procs.2023.11.115
- Luo Y 2024. Analysis of the professional development mode of higher vocational pre-school education teachers based on “Internet + Education”. Applied Mathematics and Nonlinear Sciences, 9(1), 1–16. https://doi.org/10.2478/amns-2024-1771
- Matkivskyi M & Taras T 2024. Methods and technologies for evaluating the quality of higher education in the context of international standards: A comparison of the Ukrainian and Polish experience of creating ratings. Scientific Bulletin of Mukachevo State University. Series “Pedagogy and Psychology”, 10(1), 116-127. https://doi.org/10.52534/msu-pp1.2024.116
- Maulenov K, Kudubayeva S & Razakhova B 2023. Modern Problems of Face Recognition Systems and Ways of Solving Them. Revue d'Intelli-gence Artificielle, 37(1), 209–214. https://doi.org/10.18280/ria.370126
- Messer M, Brown NCC, Kölling M & Shi M 2024. Automated grading and feedback tools for programming education: A systematic review. ACM Transactions on Computing Education, 24(1), 10. https://doi.org/10.1145/3636515
- Onyshchenko N & Serdiuk N 2025. Peculiarities of training future specialists in higher education institutions using innovative teaching technologies. Scientia et Societus, 4(1), 86-95. https://doi.org/10.69587/ss/1.2025.86
- Pan H & Chekal L 2024. Self-efficacy in educational contexts: A comparative analysis of global perspectives. Humanities Studios: Pedagogy, Psy-chology, Philosophy, 12(1), 180-187. https://doi.org/10.31548/hspedagog15(1).2024.180-187
- Pavlova D, Dovramadjiev T, Daskalov D, Mirchev N, Peev I, Radeva J, Dimova R, Kavaldzhieva K, Mrugalska B, Szabo G & Kandioglou A 2024. 3D Design of a Dental Crown with Artificial Intelligence Based in Cloud Space. Lecture Notes in Networks and Systems, 817, 437–445. https://doi.org/10.1007/978-981-99-7886-1_37
- Pi Y, Ma M, Hu A & Wang T 2024. The relationship between professional identity and professional development among special education teachers: A moderated mediation model. BMC Psychology, 12, 570. https://doi.org/10.1186/s40359-024-02075-z
- Povidaichyk O & Bartosh O 2025. Enhancing Research Readiness in Social Work Education: An Experimental Approach and Assessment. Interna-tional Journal of Educational Reform, 10567879251345784. https://doi.org/10.1177/10567879251345784
- Rahat R, Calle Müller C & ElZomor M 2024. Reinforcing infrastructure equity through leveraging Envision rating system within construction edu-cation. International Journal of Sustainability in Higher Education, 25(8), 1770–1786. https://doi.org/10.1108/IJSHE-09-2023-0409
- Rexhepi BR, Kumar A, Gowtham MS, Rajalakshmi R, Paikaray MD & Adhikari PK 2023. An Secured Intrusion Detection System Integrated with the Conditional Random Field For the Manet Network. International Journal of Intelligent Systems and Applications in Engineering, 11(3s), 14–21.
- Ronzhes O 2023. Digital applications as tools for psychological adaptation of citizens to changes. Scientific Studios on Social and Political Psy-chology, 29(2), 14-25. https://doi.org/10.61727/sssppj/2.2023.14
- Soares AH, Borba EBD & de Oliveira ST 2024. Professional development in basic education: Perspectives for teacher training. Revista Gênero e Interdisciplinaridade, 5(6), 51–63. https://doi.org/10.51249/gei.v5i06.2293
- Teremetskyi V, Kovalchuk O, Kolesnikov A, Bogdanov R, Korniienko M & Dir I 2024. Improving the Information and Legal Support of the Judi-cial System of Ukraine: Experience of the European Court of Human Rights. Journal of Ecohumanism, 3(3), 61–74. https://doi.org/10.62754/joe.v3i3.3349
- Tran Minh NT 2024. Teacher professional development in Education 5.0. In: Azar AS, Albattat A, Valeri M & Hassan V (Eds.), Preconceptions of Policies, Strategies, and Challenges in Education 5.0, 175–204. Hershey: IGI Global. https://doi.org/10.4018/979-8-3693-3041-8.ch011
- Trofymchuk A, Stenin A & Drozdovych I 2019. Modeling of information systems of service-oriented architecture. In: 2019 International Confer-ence on Information and Telecommunication Technologies and Radio Electronics, UkrMiCo 2019 – Proceedings, 9165416. Odessa: Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/UkrMiCo47782.2019.9165416
- Tytarenko V. 2023. General characteristics of the application of innovative training technologies in the formation of the professional competence of future qualified workers of the operational and rescue service of the civil defense of Ukraine. Pedagogical Sciences, 6(2), 92–97. https://doi.org/10.33989/2524-2474.2023.82.295107
- Uludag K 2023. Exploring the hidden aspects of ChatGPT: A study on concerns regarding plagiarism levels. Scientific Studios on Social and Polit-ical Psychology, 29(1), 43-48. https://doi.org/10.61727/sssppj/1.2023.43
- Varanitskyi D, Rozkolodko O, Liuta M, Zakharova M & Hotunov V 2024. Analysis of data protection mechanisms in cloud environments. Tech-nologies and Engineering, 25(1), 9-16. https://doi.org/10.30857/2786-5371.2024.1.1
- Villegas LA 2024. The influence of evaluation systems in professional growth on basic education teachers. International Journal of Innovative Sci-ence and Research Technology, 9(5), 1212–1215. https://doi.org/10.38124/ijisrt/IJISRT24MAY1961
- Vishnikina L, Samoilenko V & Davydenko O 2024. Technological support for online learning of future geography teachers. Ukrainian Professional Education, 8(1), 30-41.
- Wang G 2024. Construction of the index system for the integration of professional education and innovation entrepreneurship education in applied universities: Based on the Kirkpatrick evaluation model. International Journal of Information and Communication Technology Education, 20(1), 1–15. https://doi.org/10.4018/IJICTE.349981
- Wang X, Gu Z, Yang J, Wang Q & Wang T 2024. Professional identity and professional development agency of special education teachers in Chi-na: A moderated mediation model. Current Psychology, 43(30), 25234–25246. https://doi.org/10.1007/s12144-024-06217-9
- Wei Q 2024. Data mining methods for educational effectiveness in higher education aesthetic education programs. Applied Mathematics and Non-linear Sciences, 9(1), 1–15. https://doi.org/10.2478/amns-2024-3354
- Wei S, Zhang Z & Xiong G 2024. A practical study on the integration of innovation and entrepreneurship education and professional education in higher vocational colleges. Education Reform and Development, 6(10), 40–46. https://doi.org/10.26689/erd.v6i10.8732
- Yangiboev KN 2024. Formation of students’ technological competence in professional education. International Journal of Pedagogics, 4(10), 212–219.
- Yuriychuk N & Dadak D 2024. Pedagogical practice in the system of professional training for higher education students: Through the lens of con-temporary realities. Scientia et Societus, 3(2), 49-56. https://doi.org/10.69587/ss/2.2024.49
- Zhang H & Meng F 2024. Research on the design of higher vocational education professional certification system. Journal of Higher Vocational Education, 1(3), 161–165. https://doi.org/10.62517/jhve.202416327
- Zhang J & Hu J 2024. Enhancing English education with natural language processing: Research and development of automated grammar checking, scoring systems, and dialogue systems. Applied and Computational Engineering, 102, 12–17. https://doi.org/10.54254/2755-2721/102/20240956
- Zhou Y & Asipova N 2024. Higher education system in the Kyrgyz Republic at the present stage. Scientific Herald of Uzhhorod University. Series “Physics”, 55, 2624–2633. https://doi.org/10.54919/physics/55.2024.262dv4
Downloads
How to Cite
Received date: May 8, 2025
Accepted date: July 2, 2025
Published date: August 15, 2025