Indicators of learning effectiveness using MaPanda

01

Abstracts.

In 2022-2023, we worked with children in three main areas:

Children are involved in testing educational content. Children aged 4-10 years. Classes with children were not systematic, but at the request of the methodological department. At the beginning of the project, parents did not have a choice of characters and educational content.
Separate lessons were held in isolation from the curriculum. The children were involved in the support program of the Children of Heroes Foundation. Children aged 4-10 years. Classes were held according to selected programs lasting 6 lessons. Parents had the opportunity to choose a character and a curriculum. All children were in a state of trauma after the loss of a family member. Ages 3-11 years old. Classes were held according to the program chosen by the parents. Parents had the opportunity to choose and change the Character and, if they wished, continue their studies under another curriculum.

Classes in all areas showed effectiveness in the following indicators:

1. 1. Motivating children to learn

2. Participation in the lesson

3. Emotional state of the child

4. Quality of communication between teacher/psychologist and child

5. Level of child's trust and comfort

A total of 286 children were taught. The analysis and conclusions were based on: interviews with parents and teachers, parental questionnaires, and observations of the team's methodological staff.
02

Motivating children to learn

The motivation to learn is only forming in preschool age. One of the main stages of its formation is the emotional component. Preschool children are not yet able to sustain attention on a task for a long time and evaluate the productivity of their work.

When working with MaPanda, the child is primarily motivated to communicate with the Character. He/she maintains a dialog and does not avoid communication with the teacher. The motivation to learn is formed directly by the teacher during the tasks.

According to a survey of parents, 90% of children often remember the lesson and want to meet the Character again: The motivation to learn for preschool children is formed during the lesson and stems from the child's existing interest in the learning process.  The technical ability of the child to interact with the teacher independently without the participation of an adult (drawing, moving the LCD, etc.) increases interest in the tasks and the learning process.Primary school students (6-11 years old) A total of 112 children aged 6-11 years old have completed MaPanda's educational programs. Among them, 16 started school this academic year (1st grade). 6 have special needs, such as: ASD, Developmental Delay, Speech and Language Delay and the consequences of severe psycho-emotional trauma.28 children (25%) established contact with the teacher gradually during the first 3 classes.4 children did not establish contact with the teacher and refuse to communicate.

According to a survey of parents, the vast majority of children studied independently, without the presence of an adult.
School-age children mostly have already formed motivation to learn (except for the 1st grade).  Even children with a low emotional state complete tasks and keep their attention on the lesson topic.

Teachers note the creativity and ingenuity of the children who participate in the project's programs. Feeling relaxed and interested in the topic, students boldly put forward hypotheses and formulate interesting solutions to problems.
Preschool children (4-6 years old) A total of 169 children aged 4-6 years old have completed MaPanda's educational programs. Among them, 56 do not attend preschool. 14 have special needs, such as: Developmental delays, speech and language delays, ASD, ADHD, and the effects of severe psycho-emotional trauma25 children (13.2%) established contact with the teacher gradually during the first 3 sessions (including 10 children (17.8%) who do not attend preschool)3 children did not establish contact. All of these cases are related to the child's developmental peculiarities and/or psycho-emotional state.

Conclusion: For school-age children, MaPanda increases motivation to learn by creating a comfortable and safe emotional environment.
03

Involvement in the lesson

Behavioral engagement in the lesson is actually the child's behavior during the lesson. Cognitive engagement in the lesson is the child's desire to make efforts to achieve the goal, to work, to develop strategies for effective problem solving.

According to teachers' reports, 95.3% of preschool children are successfully kept within the curriculum and complete the vast majority of tasks.
43 of them (25.4%) are distracted by extraneous topics during the lesson, but return to their tasks through communication with the teacher. 
(20 of them have slurred speech, developmental disabilities or an unstable psycho-emotional state) 91% of school-age children remain focused on the topic and tasks during the lesson, work productively and diligently. 
9.8% of school-age children are distracted during classes, but always return to the topic of the lesson - all of them are in grades 1-2 or have special needs.  That is, this behavior is a kind of norm for them.

According to a survey of parents, children memorize and reproduce the content of lessons well. This is especially important for preschool children. In total, 7 children did not engage in communication. They avoided the dialog, refused to complete the task, turned off the camera, sketched the character, etc.

It is important to note that all of the 20 children with special needs have successfully completed or are currently completing their studies. Establishing contact with the teacher was easy, within a maximum of 2 lessons. The children study independently or with the help of their parents, depending on their characteristics. They follow the program determined by their parents together with the teacher, maintain sufficient attention during the lesson and have a stable emotional connection with the Character.

Conclusion: the indicators of cognitive engagement in the lesson are high. This is especially important when working with preschool children. Behavioral engagement correlates with the indicators typical for offline classes and is due to age and developmental characteristics. Motivating the child to communicate with the Character helps to keep the child in the dialog and return to the topic of the lesson.
04

Emotional state of the child

The vast majority of children are in high spirits during the lesson. They express emotions well. Communication with the teacher is easy and relaxed. 

53 children had a certain period of adaptation and a longer period of establishing a connection with the teacher (from 1 to 3 sessions)

They are children by age: 
9 children
4-5 years old (55% of them have slurred speech, which may be one of the reasons)
24 children 6-7 years old
20 children 8-10 years 

During 6 lessons, teachers recorded the emotional state of these children. The observation showed that the emotional state gradually increased and became quite high starting from the 3-4th lesson. With the exception of a few cases, starting from lesson 3, children express emotions well and are happy to work. 

A survey on the child's emotional state showed that 91.4% of parents assessed the impact of MaPanda training as positive.
When describing the emotional state of a child, parents use the following characteristics: "upbeat", "delighted", "stabilization of the neuropsychological state", "positive emotions", "opened up, felt comfortable", "the child opened up", "the child becomes happier", "impressed", etc. 

Make a survey in the commercial area

For a more detailed analysis of the impact of learning with the help of MaPand on the psycho-emotional state of a child, we propose the following study: Testing


Control group - 20 children aged 5 to 8 years
Duration - 3 sessions

05

Quality of communication between teacher/psychologist and child

According to a survey of 14 teachers who work with MaPanda on a regular basis, working in the application helps to:
- easily build a trusting relationship with a child (35% of respondents)
- create a fabulous and magical atmosphere of communication without additional teacher effort (35% of respondents)
- implement learning through play without using additional material (22% of respondents)

Teachers note the following advantages of working with the app over other forms of teaching:
- the availability of demonstration material directly in the app (no need to search for and prepare material before the lesson)
- no need to worry about appearance
- no need to adjust facial expressions, gestures, and voice to the child's ease of perception
- easy interaction with the child, which is lacking in other online platforms.
This is especially important for preschoolers. The child is not just an observer, but takes an active part in the learning process.

During the survey, parents used the following characteristics: "Easy and accessible form of information presentation. The child easily remembers and perceives it as a game", "The conversation is always warm and friendly", "The child was interested, the atmosphere was relaxed", "The child is comfortable in communication", "The material is perceived differently when it is not presented by an adult", "The child opens up differently".

Between the ages of 3 and 7, children develop their communication skills. They develop an active vocabulary and the ability to build dialogues.

According to speech therapists who have worked with MaPanda, one of the important features of the app is that it maximizes the use of the child's sound analyzer and speech. Thanks to the interactive format of the app (the ability to draw simultaneously), the child can maintain a dialogue with the teacher even if they do not have a sufficiently formed speech (age or developmental features), responding to the teacher's words with facial expressions, gestures, drawings, and interacting with Living Objects.

The form of the lesson as a conversation contributes to the expansion and enrichment of children's vocabulary (passive and active) and the development of coherent speech (teaching a child to consistently present thoughts in semantic and structural unity).

Table 1 (summary of teacher interviews):

Страхи на початку роботи
Головний акцент на початку роботи
Головний акцент на сьогодні
Що би ви відчували якби потрібно було провести заняття MaPanda оффлайн?
Оцініть роботу із застосунком та офлайн уроки
Переваги роботи з MaPanda
Переваги роботи офлайн
Name
Email
Phone
Country
Last Update
Status
Action
1
Страх не втримати увагу дитини
Дотримання методики
Зовнішність, більше часу на контакт
50/50
Навчання через гру
Відсутність скриптів
2
Страх не втримати увагу дитини
Емоційний контакт
Зовнішність більше контролю
50/50
Навчання через гру
Можливість використовувати наочний матеріал
3
Страх не встигнути пройти весь сценарій
Дотримання методики
Розгубленість
50/50
Легка побудова стосунків
Відсутність скриптів
4
Страх не встигнути пройти весь сценарій
Емоційний контакт
Зовнішність, Необхідність бути емоційною
50/50
Казковість
Контроль
5
Страх технічних збоїв
Дотримання методики
Можливість демонструвати матеріал
50/50
Казковість
Емоції
6
Страх технічних збоїв
Дотримання методики
Необхідність бути емоційною
50/50
Легка побудова стосунків
Фізичний контакт
7
Страх не втримати увагу дитини
Дотримання методики
Зоровий контакт
50/50
Казковість
Контроль2
8
Страх технічних збоїв
Дотримання методики
Необхідність дотримуватись образу викладача
50/50
Навчання через гру
Фізичний контакт
9
Страх технічних збоїв
Емоційний контакт
Зовнішність
Додаток
Легка побудова стосунків
Фізичний контакт
10
Безпека психіки дитини
Емоційний контакт
немає різниці
50/50
Легка побудова стосунків
Контроль
11
Страх технічних збоїв
Дотримання методики
Зовнішність
50/50
Розвиток мовлення через звуковий аналізатор
Контроль
12
Страх не встигнути пройти весь сценарій
Дотримання методики
Зовнішність
50/50
Казковість
Фізичний контакт
13
Страх не втримати увагу дитини
Емоційний контакт
Зовнішність
50/50
Легка побудова стосунків
Фізичний контакт
14
Страх не втримати увагу дитини
Технічніаспекти
Можливість демонструвати матеріал
50/50
Казковість
Фізичний контакт
06

The level of trust and comfort of the child

The character helps children interact with the teacher more calmly and with more interest. Children talk about themselves, become more relaxed and express emotions well. In most cases, the child's interest arises immediately when communicating with the Character, as opposed to interaction with an adult teacher.

The activity in answering questions does not depend on the format of interaction, but only on the child's temperament and the peculiarities of his or her development and psycho-emotional state.

When communicating with the Character, it is more difficult for children to maintain attention. This is partly due to the formal absence of an adult in the lesson (the Character is perceived as a child's peer) - children freely express their unwillingness to complete tasks, try to seize the initiative in communication. However, the lack of authority has a positive effect - without having any framework and restrictions in communication, the child feels relaxed and comfortable.

There are many studies on the use of masks, dolls, and toys in working with children. It is a common practice for psychologists working with children with psychological trauma to use masks. The mask helps the child to open up, creates a safe environment in which the child can express any emotions.

Play therapy is based on the same principle, in which a psychologist uses a toy or a glove doll in interaction with a child. Experts note the positive impact of using this technique in speech development, correctional classes with children with speech delays and communication problems.

A similar effect is present in the work of MaPanda. The formal absence of an adult creates a special level of trust between the student and the teacher.  The Fairy Tale Character cannot criticize, demand or evaluate. He encourages the child to work and rejoices in his successes together with him.

This creates additional challenges for teachers who are used to achieving learning outcomes through discipline and control. There is also a risk that for some children, the inability to see the teacher's face makes communication difficult due to the lack of facial expressions and voice changes.

But at the same time, MaPanda creates conditions for children to express their creativity and imagination. Without fear of judgment and without criteria, children are free to express themselves.

In 2007, a study was conducted in Canada that proves the positive impact of using masks and backgrounds in online learning on student motivation and the quality of their participation in the lesson. There are also a number of studies on the use of online masks in classes with children with developmental disabilities (including autism). The use of masks in online learning, as well as in offline therapy, creates a safe and comfortable environment for children, arouses curiosity and increases motivation to learn.

It is especially useful for children who have difficulty communicating with adults and peers, have difficulty adapting to a new team, are withdrawn or shy.

Creating a comfortable learning environment affects not only children's communication skills, but also their cognitive skills, which makes learning more effective.

In the surveys, parents of children who have been trained with MaPanda use the following characteristics: "The conversation was always warm and friendly", "Friendly relations with the character are built, the child opens up, shares his thoughts", "During the lesson, he opened up, felt comfortable in communication", "expression of his own thoughts and creativity, fantasies", "In a short time, the child opened up".
During the comparative analysis of teaching with the help of MaPanda and ZOOM, the following conclusions were made by the teachers and the project psychologist

According to a survey of parents of children who participated in the project with the Children of Heroes Foundation, 98.6% rated their impressions of their children's education the highest.