Recent Large Language Models (LLMs) demonstrate problem-solving capabilities suitable for educational use. This paper investigates using LLMs to create virtual agents that mimic student behavior and interact with learning platforms. Testing a modest-sized LLM on an Intelligent Tutoring System for word problem-solving revealed that the LLM could fully solve 92% of single-step problems, although their performance decreased to 14% when attempting more complex problems.

In this paper, we present and evaluate the recent incorporation of a conversational agent into an Intelligent Tutoring System (ITS), using the open-source machine learning framework Rasa. Once it has been appropriately trained, this tool is capable of identifying the intention of a given text input and extracting the relevant entities related to the message content. We describe both the generation of a realistic training set in Spanish language that enables the creation of the required Natural Language Understanding (NLU) models and the evaluation of the resulting system. For the generation of the training set, we have followed a methodology that can be easily exported to other ITS. The model evaluation shows that the conversational agent can correctly identify the majority of the user intents, reporting an f1-score above 95%, and cooperate with the ITS to produce a consistent dialogue flow that makes interaction more natural.

The relation between affect-driven feedback and engagement on a given task has been largely investigated. This relation can be used to make personalised instructional decisions and/or modify the affect content within the feedback. However, although it is generally assumed that providing encouraging feedback to students should help them adopt a state of flow, there are instances where those messages might result counterproductive. In this paper, we present a case study with 48 secondary school students using an Intelligent Tutoring System for arithmetical word problem solving. This system, which makes some common assumptions on how to relate affective state with performance, takes into account subjective (user's affective state) and objective information (previous problem performance) to decide the upcoming difficulty levels and the type of affective feedback to be delivered. Surprisingly, results revealed that feedback was more effective when no emotional content was included, and lead to the conclusion that purely instructional and concise help messages are more important than the emotional reinforcement contained therein. This finding shows that this is still an open issue. Different settings present different constraints generating related compounding factors that affect obtained results. This research confirms that new approaches are required to determine when, how and where affect-driven feedback is needed. Affect-driven feedback, engagement and their mutual relation have been largely investigated. Student's interactions combined with their emotional state can be used to make personalised instructional decisions and/or modify the affect content within the feedback, aiming to entice engagement on the task. However, although it is generally assumed that providing encouraging feedback to the students should help them adopt a state of flow, there are instances where those encouraging messages might result counterproductive. In this paper, we analyze these issues in terms of a case study with 48 secondary school students using an Intelligent Tutoring System for arithmetical word problem solving. This system, which makes some common assumptions on how to relate affective state with performance, takes into account subjective (user's affective state) and objective (previous problem performance) information to decide the difficulty level of the next exercise and the type of affective feedback to be delivered. Surprisingly, findings revealed that feedback was more effective when no emotional content was included in the messages, and lead to the conclusion that purely instructional and concise help messages are more important than the emotional reinforcement contained therein. This finding, which coincides with related work, shows that this is still an open issue. Different settings present different constraints and there are related compounding factors that affect obtained results, such as the message's contents and their target, how to measure the effect of the message on engagement through affective variables considering other issues involved, and to what extent engagement can be manipulated solely in terms of affective feedback. The contribution here is that this research confirms that new approaches are needed to determine when, how and where affect-driven feedback is needed. In particular, based on our previous experience in developing educational recommender systems, we suggest the combination of user-centred design methodologies with data mining methods to yield a more effective feedback.

Despite many research efforts focused on the development of algebraic reasoning and the resolution of story problems, several investigations have reported that relatively advanced students experience serious difficulties in symbolizing certain meaningful relations by using algebraic equations. In this paper, we describe and justify the Graphical User Interface of an Intelligent Tutoring System that allows learning and practising the procedural aspects involved in translating the information contained in a story problem into a symbolic representation. The application design has been driven by cognitive findings from several previous investigations. First, the process of translating a word problem into an algebraic form has been treated in isolation, and clearly separated from algebraic manipulation. Second, the user interface has been devised to force a systematic approach to problem solving, and also avoid the use of a non-algebraic reasoning. Third, sensor-free affective support has been added by using a machine learning approach that relies on data captured from a series of experimental sessions involving 48 subjects. The evaluation of the resulting application has revealed a positive and significant impact in learning gains.

The selection of an appropriate sequence of activities is an essential task to keep student motivation and foster engagement. Usually, decisions in this respect are made by taking into account the difficulty of the activities, in relation to the student's level of competence. In this paper, we present a dynamic model that aims to predict the average performance of a group of students at solving a given series of maths problems. The system takes into account both student- and task-related features. This model was built and validated by using the data gathered in an experimental session that involved 64 participants solving a sequence of 26 arithmetic problems. The data collected from the first 16 problems was used to build the model, and the remainder were employed to validate it. Results show a correlation with r = 0.59 between the real and predicted scores, and support the effectiveness of the model at anticipating the students' performance over a sequence of tasks.

One basic adaptation function of an Intelligent Tutoring System (ITS) consists of selecting the most appropriate next task to be offered to the learner. This decision can be based on estimates, such as the expected performance of the student, or the probability that the student successfully solves each particular task. However, the computation of these values is intrinsically difficult, as they may depend on other complex latent variables that also need to be estimated from observable quantities, e.g. the current student's ability. In this work, we have used system dynamics to model learning and predict the student's performance in a given exercise, in an existing ITS that was developed to teach students solve arithmetic-algebraic word problems. The high correlation between the predicted and real scores outlines the potential of this type of modeling as a prediction tool to support the decision about the next task that should be offered to the learner.