APPLICATION OF ARTIFICIAL INTELLIGENCE TECHNIQUES FOR CLASSIFICATION OF ESCAPE FROM THE TOPIC IN ESSAYS
Keywords:
essays, automatic essay evaluation, go off-topic, artificial intelligenceAbstract
The process of manual correction of essays causes some difficulties, among which we point out the time spent for correction and feedback to the student. For institutions such as elementary schools, universities and the National High School Exam in Brazil (ENEM), such activity demands time and cost for the evaluation of the texts produced. Going off-topic is one of the items evaluated in the ENEM essay that can nullify the whole essay produced by the candidate. In this context, the automatic analysis of essays with the application of techniques and methods of Natural Language Processing, Text Mining and other Artificial Intelligence (AI) techniques has shown to be promising in the process of automated evaluation of written language. The goal of this research is to compare different AI techniques for the classification of going off-topic in texts and identify the one with the best result to enable a smart correction system for essays. Therefore, computer experiments were carried out to classify these texts in order to normalize, identify patterns and classify the essays in 1,320 Brazilian Portuguese essays in 119 different topics. The results indicate that the CNN classifier (convolutional neural network) obtained greater gain in relation to the other classifiers analyzed, both in accuracy and in relation to the results of false positives, precision of metrics, recall and F1-Score. In conclusion, the solution validated in this research contributes to positively impacting the work of teachers and educational institutions, by reducing the time and costs associated with the essay evaluation process.
Downloads
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Educação em Revista
This work is licensed under a Creative Commons Attribution 4.0 International License.
All contents of the publication, except where otherwise noted, is licensed under a Creative Commons license of type BY attribution. This license allows others to distribute, remix, adapt and create from work published in Educação em Revista, even for commercial purposes, as long as they give it due credit for the original creation. If the author is responsible for remixing or adapting, he should send a message to the editorial department of Educação em Revista informing such a situation with proof of the credit attribution of the original publication.