Abstract
Ideological and political education plays an important role in supporting social talent input. However, the current evaluation effect of ideological and political education is difficult to quantify. Therefore, in order to improve the evaluation effect of ideological and political education, based on artificial intelligence algorithms, this study combines machine learning ideas and the current status of ideological and political education to build a fuzzy analytic hierarchy process model of the of ideological and political teaching quality based on machine learning and artificial intelligence. Moreover, this study uses a three-tier structure to build a model network structure, and based on the characteristics of fuzzy evaluation, this study uses the expert system to conduct data management, operation and control of model evaluation, and build a corresponding database to update the data in real time. In addition, in order to verify the effect of the model, this study sets simulation experiments to analyze the model performance. From the point of view of running effect and running speed, this research model meets the actual needs of the system, so it can be applied to the evaluation process of ideological and political teaching quality in colleges and universities.
Introduction
With the deepening of the reform of the new ideological and political curriculum standards, from teaching concepts, curriculum structure settings, textbook content changes to teaching form design, are all impacting and changing the traditional ideological and political classrooms and affecting the learning and daily life of students. However, the deficiencies and shortcomings of the existing classroom teaching evaluation have gradually emerged: the final teaching evaluation with teacher as the center and with exam selection as the final purpose not only hinders the growth of teachers, affects the independent growth and comprehensive development of students, but also seriously hinders the further deepening of ideological and political curriculum reform. Therefore, how to scientifically and effectively carry out ideological and political classroom teaching evaluation and promote the implementation of the core quality of the discipline through the reform of classroom teaching evaluation to make the classroom teaching evaluation activities not only highlight the comprehensive development of students, but also closely integrate the key competences of the discipline with the characteristics of the discipline itself is a problem that requires us to constantly think, explore and strive to solve in actual education and teaching [1].
As an important monitoring mechanism for teaching activities, classroom teaching evaluation is an important means to promote the development of students and teachers, improve the quality of education and teaching, and achieve the goals of classroom teaching. It not only determines the direction of classroom teaching, but also has a profound impact on the level and height of teaching quality. However, in the traditional classroom teaching evaluation practice in our country, the evaluation of students pays too much attention to academic performance and ignores the formation of students’ qualities, and pays too much attention to the ranking order and ignores the student’s learning process, and pays too much attention to the teacher’s dominant position and ignores the students’ active participation. The classroom teaching evaluation is like a short board, which greatly limits the realization of classroom teaching benefits [2]. Therefore, the research on the ideological and political classroom teaching evaluation based on the key competences of the discipline is not only a continuous and in-depth discussion of the new version of the ideological and political curriculum standards, but also to answer the demands and expectations of the party and the country for education, that is, who to train and how to train people
First of all, the developmental evaluation method and concept have opened up a new research area for teaching evaluation of ideological and political courses, and the developmental evaluation method can make the role of ideological and political education to students’ moral education play a better role, and can enable the country to better provide moral education services to students [3]. Secondly, through the research of this paper, it is found that it can further enrich the relevant theoretical system, improve the teaching evaluation theory, guide the practice with the theory, and make the evaluation method that promotes development more maturely implemented in the evaluation of ideological and political courses. The enrichment of the theoretical system and the maturity of practice can enhance the effectiveness of the teaching evaluation of political lessons and promote the true realization of the goal of moral education. Thirdly, the research in this paper can make the developmental evaluation theory better serve the teaching of politics, help to achieve the teaching goals, improve the quality of teaching, and promote the continuous progress of teachers and students through developmental evaluation.
Related works
The literature [4] put forward ‘education evaluation”, and believes that “education evaluation is essentially a process of determining how much education goals are achieved in the curriculum and teaching program’. The literature [5] believed that classroom evaluation is an evaluation of students’ learning achievements, and does not emphasize evaluation of teachers’ teaching quality. The literature [6] believed that classroom evaluation is a process of improving teaching by collecting information from students during the learning process. These two views mainly emphasize the evaluation of students and the formative function of evaluation. The focus of foreign classroom evaluation research is the evaluation of student learning. The Western world has produced a series of learning theories in the process of exploring how humans learn and how learning occurs. From cognitive learning theory to humanistic learning theory and from constructivist theory to situational learning theory, the study of learning theory has been continuing and developing. There is also a clear definition of “learning assessment” for “learning evaluation”, which refers to the evaluation of student learning [7]. At present, the international learning evaluation research community regards the combination of evaluation and teaching as the main trend of research, that is, how to effectively evaluate students in classroom teaching to achieve the purpose of promoting student learning and cultivating student literacy. In recent years, researchers from various countries have studied learning evaluation from different perspectives and put forward new ideas for learning evaluation, including formative evaluation, developmental evaluation, evaluation of learning promotion, evidence-centric evaluation, authenticity evaluation, and student participation evaluation [8]. The classroom evaluation has a formative function. The literature [9] cited formative evaluation to classroom teaching and student learning. The literature [10] proposed to pay more attention to teachers’ feedback to students and students’ self-evaluation and self-monitoring. In the 1990 s, the literature [11] did further research on formative evaluation and proposed to combine formative evaluation with teaching. On this basis, the “evaluation of learning promotion” replacing the formative evaluation was first proposed, and it believed that the origin of the classroom is students, and the origin of classroom evaluation is to promote student learning. The main points of the evaluation concept are students need to participate in the evaluation, teachers need to provide effective feedback on the student’s learning process and effects, and its emphasis on students’ self-evaluation and reflection. The literature [12] proposed authenticity evaluation and emphasized to investigate the learning effect and mastery of students’ knowledge and skills, as well as the development of various complex abilities such as critical thinking, cooperative communication, etc.in real scenarios and real tasks. The authenticity learning evaluation uses the evaluation methods of authenticity tasks and gauges, as well as evaluation tools such as portfolios, concept maps, role-playing and diaries to evaluate students. The literature [13] proposed “evidence-centered evaluation". This method emphasizes that the evaluation should focus on the student’s learning process, clearly describe the process of the student’s knowledge acquisition, learning skills, and comprehensive development, obtain effective evidence that reflects the student’s learning and ability level, and evaluate the student based on the evidence. The literature [14] has established a set of evaluation system that points to student learning through years of reform and proposed evaluation for learning, evaluation as learning, and evaluation of learning to replace the previous diagnostic evaluation, formative evaluation, and final evaluation.
The literature [15] believed that classroom evaluation is a process in which teachers collect and analyze students’ learning information in the classroom, judge students’ learning through certain standards, and then make teaching decisions, the literature [16] believed that classroom evaluation is an evaluation of classroom teaching, and literature [17] believed that classroom evaluation is an evaluation of the “learning” of students, the “teaching” of teachers and the relationship between teaching and learning. The differences between these three views are mainly focused on the evaluation object. Since the reform of the new curriculum, the emphasis has been placed on students’ dominance in classroom teaching. Therefore, the current academic research object on classroom evaluation has begun to shift to evaluation of student learning. The literature [18] believed that classroom evaluation is the activity and process of collecting and analyzing the learning information of students in order to grasp the learning status of students, clarify the teaching effect of the classroom, and promote the efficient development of students. In daily teaching, classroom evaluation includes two types: one is direct feedback from teachers in the classroom teaching process, such as evaluating language, emotions, expressions, and actions; the other type is the evaluation of student learning, including the evaluation of practice questions and assignments, the setting of evaluation tasks in the classroom, the questions and observations of students in the classroom, etc. [19].
The literature [20] put forward from the perspective of evaluation content, learning evaluation is to judge the personality qualities acquired by students in the learning process and the learning process itself. Literature [21] puts forward from the perspective of evaluation process that learning evaluation is the process of collecting the performance and learning effects of students in the learning process through observation, investigation and testing and then making value judgments to revise and reflect on the learning objectives, which is based on learning objectives. Unique representation of intuitionistic fuzzy model and various applications related to it is proposed based on critical decision making [22]. Intuitionistic fuzzy model is utilised for enhancing the fingerprint and it’s matching with feature extraction model [23]. Histogram based cluster selection is used for skin lesion segmentation with help of fuzzy c-means [24]. Rule based information fuzzy system for analyzing for localizing thrombus in artery [25].
Determination of evaluation index weight
In this paper, the evaluation index weights will be calculated and determined using expert scoring and analytic hierarchy process. This article will use Yaahp software to calculate the index weight [26].
The first step is to collect the expert’s scoring results; the second step is to input the expert’s scoring results on the importance of the indicators into Yaahp software to calculate and obtain the weight of each indicator; The third step is to adjust the constructed judgment matrix according to the consistency test results obtained by Yaahp software; the fourth step is to form a complete fuzzy hierarchy evaluation index weight system. The specific process is shown in Fig. 1 [27, 28].

Flow chart for determining the weight of fuzzy hierarchy evaluation indicators.
The steps to determine the index weight are as follows:
(1) Building a hierarchical structure model
According to the evaluation purpose of the problem to be studied in the paper, the evaluation purpose is divided into multiple dimensions, and the evaluation indicators are designed under these dimensions, which can be divided into first-level indicators, second-level indicators, and third-level indicators. The layer below the target layer is the criterion layer U1, U
ij
, and their corresponding relationship is [27]:
Among them, i = 1, 2, 3, ⋯ , m ; j = 1, 2, 3, ⋯ , n.
(2) Constructing a judgment matrix of pairwise comparison
After the hierarchical structure model is established, the membership relationship between the upper and lower levels of each element is determined accordingly as shown in Fig. 2. For example, taking the target layer U and the criterion layer U
i
as examples, the following judgment matrices A and A
i
can be established respectively:
Among them, A ij (i = 1, 2, 3, ⋯ , m ; j = 1, 2, 3, ⋯, m) and a ij (i = 1, 2, 3, ⋯ , n ; j = 1, 2, 3, ⋯ , n) often take the following values:
The software Yaahp is used to calculate the expert scores to get the weight of each indicator (taking the first-level indicator as an example as in Table 1).
(3) Consistency test
Since the matrix is scored by experts, there is a certain degree of subjectivity. Through the consistency test, the inconsistency of the matrix can be controlled within the allowable range as in Fig. 3. The specific step is as follows:
First, the maximum feature root of the matrix A-B is calculated:
Second, the consistency index (CI) is calculated:
Again, corresponding to the average random consistency index RI (Random Index), calculate CR (Consistency Ratio)
When CI < 0.1, CR < 0.1, the judgment matrix passes the consistency test, otherwise the consistency of the judgment matrix fails. At this time, the algorithm needs to return to modify the judgment matrix until the consistency test is passed as in Table 2. Through the Yaaph software, the consistency test results of the 6 judgment matrices are calculated. The results are shown in Table 3. It can be seen that the consistency ratio of all judgment matrices is less than 0.1, so all judgment matrices pass the consistency test.
T.L.Saaty ‘s 1–9 scale method
Average consistency index
The output table of the consistency test results of the judgment matrix
The fuzzy set theory was first proposed by American automatic control expert L.A. Lad in 1965. Moreover, he founded fuzzy mathematics on this basis. Fuzzy mathematics can be applied to study the relationship between fuzzy things and can be quantitatively analyzed using mathematical methods. The fuzzy comprehensive evaluation method is based on fuzzy mathematics and uses fuzzy sets as a theoretical basis to comprehensively evaluate a fuzzy thing from various elements.
This article uses the fuzzy comprehensive evaluation method to calculate the comprehensive score of the index system as in Table 4. The main steps of this evaluation method are:
(1) Establishing evaluation index set
The index set u of fuzzy comprehensive evaluation objects is established to form a set of all indexes of evaluation objects, and u can be expressed as:
Among them, the element U
j
represents the ith factor affecting the evaluation object. For objects with multiple evaluation factors, there is also a secondary index U1, which can be expressed as:
Among them, U ij represents the J-th factor index of the i-th criterion layer, and i = 1, 2, 3, ⋯ , m ; j = 1, 2, 3, ⋯ , n.
(2) Defining comment set V and score F
V can generally be expressed as:
This article divides the evaluation of each index into five levels: very consistent, consistent, general consistent, inconsistent, and very inconsistent. Therefore, the comment set is expressed as:
V = (V1, V2, V3, ⋯ , V u ) = (very consistent, consistent, general, inconsistent, and very inconsistent)
The score set corresponding to the comment set is F = (F1, F2, F3, F4, F5), and F represents five scores corresponding to the comment set.
(3) Establishing an evaluation matrix R n to determine the membership of each evaluation factor
According to the created comment set V, the degree of membership of each index factor U1 and U
ij
in the set U is calculated. Through calculation, the fuzzy matrix R of the fuzzy relationship between U and V, the fuzzy matrix R1 of the fuzzy relationship between U1 and V, and the fuzzy matrix R
ij
of the fuzzy relationship between U
ij
and V can be obtained.
Among them, the element r ij (i = 1, 2, 3, ⋯ , m ; j = 1, 2, 3, ⋯ , p) in the fuzzy matrix R represents the membership degree of each element U1 in the set U to each rating level in the comment set V.
Similarly, the following results can be obtained:
Among them, the element r ijk (j = 1, 2, 3, ⋯ , n ; k = 1, 2, 3, ⋯ , p) in R1 represents the membership degree of each element U ij in the set U1 to each level in the comment set V.
(4) Computing fuzzy comprehensive evaluation set
According to the index weight ω
n
and the evaluation matrix R
n
, the fuzzy comprehensive evaluation set Y
n
of the index system is calculated.
(5) Calculating fuzzy comprehensive score X
According to the calculated fuzzy comprehensive evaluation set and the set score set F, the final fuzzy comprehensive score value is obtained.
Based on the model level, index structure, and survey results and scoring criteria of the questionnaire survey, the fuzzy evaluation frequency distribution of this study is obtained:
The evaluation of each index in this article is divided into five levels: very consistent, consistent, general consistent, inconsistent, and very inconsistent, corresponding to 100 points, 80 points, 60 points, 40 (1) Comprehensive evaluation value of index layer as mentioned in Table 5.
For example, set goals. (C1). In the questionnaire survey, according to the selection of C1 in 384 valid questionnaires, 19% of people think it is very consistent, 21% of people think it is in consistent, 49% of people think it is in general consistent, and 8% of people think it is inconsistent. 3% of people think it is very inconsistent. Therefore, after normalizing the matrix (0.19, 0.21, 0.49, 0.08, 0.03), the fuzzy comprehensive evaluation value obtained is:
Similarly, the fuzzy comprehensive evaluation score of the 20 indicators of index layer is shown in Table 6, and the statistical graph is drawn as shown in Fig. 4.
Score sets corresponding to scale comments
Score table of fuzzy comprehensive evaluation of index layer
Fuzzy comprehensive evaluation scores of criterion layer

Hierarchical structure diagram of fuzzy hierarchical evaluation.

Evaluation index weights.

Score diagram of fuzzy comprehensive evaluation of index layer.
(2) Calculation of comprehensive evaluation value of criterion layer
According to the evaluation table of the survey data provided as in Fig. 5, the fuzzy evaluation matrix is as follows: The fuzzy evaluation matrix of training preparation is:
The fuzzy evaluation matrix of training implementation is:
The fuzzy evaluation matrix of knowledge acquisition is:
The fuzzy evaluation matrix of behavior improvement is:
The fuzzy evaluation matrix of performance improvement is:
According to the weight distribution, the weights of the first-level indicators and the second-level indicators are as follows:
According to the formula, the comprehensive evaluation set of the index system can be expressed as Y
n
(n = 1, 2, 3, 4, 5), then the fuzzy comprehensive evaluation value of training preparation.
Similarly, the following results can be obtained:
The fuzzy comprehensive evaluation value of training implementation is:
The fuzzy comprehensive evaluation value of knowledge acquisition is:
The fuzzy comprehensive evaluation value of behavior improvement is:
The fuzzy comprehensive evaluation value of performance improvement is:
Through calculation, it can be concluded that the fuzzy comprehensive evaluation value score of the criterion layer is:
Our country promotes quality education, and quality education needs to be directed to all students. For the development of each student, the new student-oriented curriculum reform concept should be implemented into the classroom. In the classroom, teachers should pay attention to the development needs of each student, give them equal attention and incentives, create equal opportunities and conditions for learning progress, help correct positive or bad thoughts or behaviors, so that students can develop in a more perfect direction.
Figure 6 shows the artificial intelligence evaluation model of ideological and political education. The model is a three-layer network structure, where the user layer is mainly school staff and ideological and political teachers. However, in the actual ideological and political classroom, teachers still cannot convert the evaluation of students’ core quality. At present, teachers still regard the basic knowledge of the subject and the skills of major topics as the focus of ideological and political studies, thus ignoring the cultivation of students’ key abilities and essential qualities.100 people are surveyed, and the results are shown in Fig. 7.

Statistical diagram of fuzzy comprehensive evaluation scores at the criterion level.

The artificial intelligence evaluation model of ideological and political education.

The way students learn in high school ideological and political classes.
In a survey of students about the question “How do you usually study in the political class?”, it was found that the current high school students’ learning methods in the political classroom are mainly listening and copying notes, accounting for 57%, while the learning methods of active thinking, group discussion and personal activities account for the minority. This also reflects that the teaching methods of the ideological and political classroom have not been reformed quickly under the requirements of core quality, and it also shows that teachers pay more attention to students’ subject knowledge learning in learning evaluation. Therefore, in the question “What aspects of the ideological and political class teachers pay more attention to you?”, 67% of the students answered ‘the ability to use political subject knowledge to solve problems’, 22% of the students answered ‘reciting the concept of knowledge’ and only 11% of the students answered that teachers pay attention to the evaluation of their “core quality development level’. This directly reflects that the current ideological and political teachers pay little attention to the students’ core quality level in the evaluation. Even in the question “Do you understand core quality?", only one-third of the students understand core quality. This shows that the current implementation of core quality in classroom teaching and evaluation is far from enough. The statistical results are shown in Fig. 8.

Evaluation contents of political teachers for students.
In the interviews and classroom observations with teachers, we found that even under the influence of the current core quality background, some teachers still regard classroom learning evaluation as a means of testing students’ knowledge and judging their academic performance and progress in daily teaching. Moreover, teachers regard classroom learning evaluation as a vassal of external examinations, and still adopt a series of paper-and-pencil tests such as traditional knowledge point recitation, silent writing, and test paper test to evaluate students’ performance and ability, but do not pay much attention to the evaluation of students’ comprehensive quality and ability development in the learning process. In addition, it is difficult to measure the true appearance of students’ emotions, thoughts, and qualities only by using paper and pencil tests. At the same time, it is difficult to fully grasp the development of students’ comprehensive qualities by grading students’ performance, writing some suggestions or encouraging words, and more difficult to complete the current core quality requirements. In the survey, we also found that although the traditional evaluation method of paper-and-pencil test still occupies the dominant position in classroom teaching, some emerging evaluation methods also appear in the classroom. Among the evaluation methods, the more common methods mainly include daily learning behavior evaluation and verbal timely evaluation. Some teachers use rating scales to evaluate students’ individual and group behaviors and use growth record bags to record students’ learning process and results. These evaluation methods can play an effective role in evaluating students’ core quality development. However, the popularization of these methods and the proposal of more effective evaluation methods also require continuous innovation and development to further effectively implement the core quality of students. The learning evaluation method carried out by teachers is shown in Fig. 9.

Evaluation methods of learning carried out by teachers.

The process of learning evaluation implementation in the ideological and political classroom.
The connotation of expressive evaluation makes many people find it unpredictable. They think that its forms are diverse, and think that it is the main feature of students to show behavior and evaluate students’ works and performance through activities. In fact, the key point that distinguishes performance evaluation from general evaluation is that its evaluation content is not general knowledge literacy, but the higher order thinking and complex cognitive ability that students show in the process of analyzing and solving problems in actual situations. This is consistent with the core quality currently advocated, so performance evaluation is an important means of implementing core quality. The implementation process of ideological and political classroom learning evaluation under the perspective of core quality is roughly divided into the following four steps:
Under the instruction of the new curriculum standards, especially under the perspective of core quality, we must take evaluation as a way to cultivate students’ developmental abilities, and truly integrate evaluation and teaching to achieve consistency in teaching, learning and evaluation. At this time, the classroom as a key stage for cultivating students will inevitably provoke the burden of implementing core quality. The classroom evaluation should reposition its role under the new background of core quality. It is no longer a student selection officer and teacher rater, but a supporter of student and teacher growth. In the process of assisting, we should pay attention to the key role of performance evaluation in core quality evaluation. Performance evaluation focuses on the student’s learning process, and takes the students’ complex abilities and higher-order thinking in the process of solving real situation problems as evaluation content, which is in line with the cultivation goals of the core quality in the new curriculum standard and coincides with the concept of the active subject curriculum. In this field, we have to go a long way. With the advent of the information age, the acceleration of the globalization process and the rapid development of science and technology have placed higher and higher requirements on everyone’s own development. In the face of increasingly complicated real life, the fixed and routine subject knowledge that the individual emphasized by traditional education can no longer meet the needs of social development. The progress of the times has called for education and requires individuals to have meticulous and high-level thinking and judgment, understand teamwork, and the ability to create and regenerate, thereby further solving challenging and complex tasks in the real world. This kind of education requires that the current teaching methods and evaluation methods can surpass themselves and complete the reform. All in all, the model constructed in this study meets actual needs and has certain practical significance.
How to achieve the actual effect of teaching is the focus of attention in the field of education and the practical requirements of the current teaching situation as in Fig. 10. The ideological and political course in colleges and universities is a major feature of the development of my country’s higher education and an important practical path to implement the fundamental task of establishing morality. The effectiveness of college ideological and political teaching directly determines the quality of college personnel training. Based on the fuzzy analytic hierarchy process model, this study builds an artificial intelligence evaluation model for ideological and political education based on machine learning. The model constructed in this study is a three-layer network structure, in which the user layer is mainly school staff and ideological and political teachers. These personnel are connected to the system through a human-computer interaction interface. After the user enters the data, he will enter the data exchange center and the data processing center, combine the expert system to evaluate the teaching process, and feedback the data to the user terminal through the system data transmission network. In addition, this study uses simulation experiments to analyze model performance. From the point of view of running effect and running speed, this research model meets the actual needs of the system, so it can be applied to the evaluation process of ideological and political teaching quality in colleges and universities.
