Abstract
Due to the complexity of the calculation process of the existing methods, the efficiency of data fusion of the power grid model is low. In order to improve the knowledge fusion effect of power grid model, this paper studied the knowledge fusion method of power grid model based on Seq2seq half pointer and half label method. The Text Rank algorithm is used to calculate the weight of semantic nodes of each grid model, and combined with the topological potential method, the semantic information of the grid model is extracted according to the final weight value, and the Seq2Seq semi-pointer semi-label model framework is constructed. The data of the scheduling automation system OMS and the production management system PMS are used as input. The extracted candidate mesh model semantics and the original mesh model semantics are encoded by Seq2Seq half-pointer half-label model. The semantic data of the power grid model is fused and sent to the Seq2Seq encoder. After the training is completed, the effective information is extracted from the power grid model through the Seq2Seq model to complete the knowledge fusion of the power grid model. Experimental results show that this method eliminates the redundant part of the basic attributes of each data source in the substation grid model after knowledge fusion, and the description of each basic attribute is more standardized, unified and perfect. Under different mesh model data dimensions, the support of the proposed method is all above 98%. The model trained by the proposed method tends to be stable after 120 iterations, and the precision, recall and F1 of the test set are 0.98, 0.93 and 0.91, respectively. At the same time, this method has high efficiency in the knowledge fusion processing of the power grid model, and its data processing speed is less than 160 s. The average integrity of the private data of the power grid model is 98.86%, indicating that the proposed method can better ensure the integrity of the data. Finally, compared with the application of other methods under different data amounts, the mean square error obtained by the proposed method is the smallest, indicating that the proposed method effectively improves the fusion accuracy.
Keywords
Introduction
In modern society, as an important infrastructure to support social and economic development, the stable and efficient operation of power grid is very important [1]. In order to better understand and manage power grids, deep research and analysis of power grid models are needed [2]. However, traditional power grid model research methods often fail to make full use of the semantic information of the model, which limits the understanding and application of the power grid model to a certain extent [3].
In recent years, with the rapid development of deep learning and natural language processing technology, text-based data processing and model construction methods have begun to attract more and more attention in the field of power grid [4]. However, existing research works have obvious shortcomings in knowledge fusion of power grid models. On the one hand, these methods often ignore the topological structure information of the power grid model, which makes the model unable to fully understand the operation mechanism of the power grid [5]. On the other hand, the existing methods often lack effective means to extract and utilize the semantic information of the power grid model, which limits the performance and application range of the model [6].
In order to solve these problems, many scholars have carried out research on it and achieved considerable research results. WANG Xin et al. proposed a self-organizing map knowledge fusion algorithm for big data of distribution network based on self-organizing map neural network under the premise of facing the big data environment. Through data clustering between homogeneous data, ontology mapping between heterogeneous data and self-organizing iteration between multi-dimensional data, the associated knowledge is effectively fused and certain real-time requirements are guaranteed. This method promotes the fusion of multi-dimensional heterogeneous data, but the fusion accuracy still needs to be improved [7]. LIU Dong et al. proposed a knowledge graph construction method for intelligent retrieval of power grid regulation information. The semantic relationship in scheduling operation is identified based on deep learning, and the rule transformation method is used to extract the power grid model information to establish the knowledge graph of regulation information, and the application scheme of intelligent retrieval of regulation information is proposed. This method has high recognition accuracy, but it is difficult to deal with applications in different scenarios and has certain limitations [8]. LI Xiaolu et al. proposed a knowledge graph verification method of power grid model based on shape constraint language. CIM is used to construct the concept graph and entity graph of power grid model, and the CIM pattern consistency shape, as well as cross-class and cross-attribute consistency shape for power grid model verification are set. This method improves the flexibility of the model, but it has higher requirements for the dynamic evolution process of the calculation process, large amount of calculation and easy to produce errors [9]. In order to solve the above problems, this paper proposes a knowledge fusion method of power grid model based on Seq2seq semi-pointer and semi-label method. This method aims to improve the performance and application range of the power grid model by combining the topological structure information and text semantic information of the power grid model.
Specifically, firstly, the semantic information extraction method of power grid model based on topological TextRank algorithm is used to extract key semantic information from the text description of power grid model. Then, with the help of the knowledge fusion strategy of half pointer and half annotation, the extracted semantic information is fused with the topological structure information of the power grid model to obtain a more comprehensive and accurate representation of the power grid model. The method proposed in this paper realizes the effective fusion of semantic information and topology information of power grid model, and can effectively improve the performance of power grid model. It brings new research ideas and method improvements to the field of power grid modeling and knowledge fusion, and helps to promote the further development of this field.
Seq2seq power grid model knowledge fusion method
Use Text Rank algorithm to calculate the weight of each grid model semantic node [10], and extract the grid model semantic information according to the final weight value in combination with the topological potential. The extracted information provides additional information for the subsequent generative grid model; Then, a half pointer and half label model framework based on Seq2Seq (Sequence to Sequence) is constructed, and the extracted candidate grid model semantics and the original grid model semantics are coded respectively. Then, the grid model semantics are fused and sent to the encoder of Seq2Seq. After training, the model will be able to extract effective information from the grid model and complete the grid model knowledge fusion.
Semantic information extraction of power grid model based on topological TextRank algorithm
The implementation process of TextRank algorithm is as follows:
Set up {U1, U2, ⋯ U n } as a collection of semantic nodes of the power grid model, which is used to build the network diagram of the power grid model G = (U, F, W) represents the network diagram of power grid model, where F is an edge set, W is a weight set, and the Text Rank algorithm is used to solve the weight of each semantic node of the power grid model [11].
The expression of probability transfer matrix between semantic nodes of power grid model is as follows:
Through the probability matrix between the semantic nodes of the power grid model and the network diagram of the power grid model, the weight of each semantic node of the power grid model can be calculated iteratively. The formula is as follows:
IN (U i ) represent the semantic node pointing to the power grid model U i set of all semantic nodes of power grid model, OUT (U j ) represent the semantic node of power grid model U j the set of semantic nodes of the grid model pointed to; w ij represent the similarity between semantic node of power grid model U i and semantic node with power grid model U j ; WQ (U j ) represents the weight value after the last iteration; ϑ is the probability matrix element weight [12].
At the same time, pay attention to the weight of the semantic nodes of the power grid model. Generally, the initial value weight of all the semantic nodes of the power grid model is set to 1 [13]. After multiple iterations, the weight value of each semantic node of the power grid model tends to be stable and converges,
A0 = (1, 1, ⋯ , 1)
T
, and the convergence formula is as follows:
The above formula is used to calculate the results of each iteration. When the difference between the two iteration results is close to 0, the calculation will be stopped, and the weight value vector containing the semantic nodes of each grid model can be obtained. Then, the weight value vector will be sorted according to the size of the weight value, and the content will be selected. The main steps of semantic information extraction of power grid model are as follows:
Step 1: Pretreatment. Complete segmentation and extraction, part of speech tagging and other operations of the semantic information of the power grid model [14], Z ={ Z1, Z2, ⋯ Z n } semantic information set of power grid model.
Step 2: Calculate the similarity between the semantic information of the power grid model. The similarity calculation is based on the content overlap rate between the semantic information of the power grid model. The number of identical terms contained in the semantic information of the two power grid models is calculated [15]. The formula is as follows:
If there is semantic correlation between two edges, they can be used to form an edge. The weight of the edge is:
Step 3: Use formula (2) to iteratively calculate the semantic information weight of the power grid model until convergence, and get the semantic information score of each power grid model.
Step 4: Sort and select. The scores in the third step are used for ranking, and the most important semantic information of the power grid model is selected as the candidate semantic information of the power grid model [16].
Step 5: Compose the semantic information of the power grid model. Select the final content from the fourth step according to the relevant requirements.
TextRank algorithm constructs a term graph through the co-occurrence relationship of words in the grid model semantics in the window in the iterative process, and the weights on both sides are transferred evenly, without considering the structure of the grid model semantic information. In this paper, the TPC TextRank (Topology Potential Combined TextRank) algorithm, which combines topological potential with TextRank algorithm, is proposed by comprehensively considering the local and global importance of words in the semantic information of power grid model.
(1) Local importance.In the semantics of power grid model, words are often combined by grammatical rules. If a sentence is abstracted as a network with words as its vertices, the vertices will interact with each other due to the syntactic structure [17]. The topological potential value represents the joint action of nodes in the network by other nodes within the influence range. After the calculation method is modified, the influence between two individual nodes can be obtained, which is used as the transfer probability between words in the semantics of the power grid model. The calculation is as follows:
Γ ij as the shortest distance between semantic nodes of two power grid models. Set up Γ ij = |Index (u i ) - Index (u j ) |, when Γ ij > ϒ, Γ ij = 0; When Γ ij ϒ at this time Γ ij = |Index (u i ) - Index (u j ) | in order to improve the transfer probability matrix of TextRank algorithm, the topological potential between words in the semantics of the power grid model is calculated as the weight of the connecting edge.
(2) Global importance. TextRank algorithm adds semantic information such as word frequency and word distribution to eliminate the impact of high-frequency words in power grid models. The implementation of inherent attributes of nodes mainly includes two parts: ψ (u
j
) indicates the number of occurrences of semantics in the power grid model; P (u
j
) represents the distribution of semantic information in the power grid model. It should be noted that if the grid model semantics are more widely distributed in the grid model, it is more likely to become the key grid model semantics [18]. The calculation of ψ (u
j
) and P (u
j
) is shown in formula (8):
λ
j
is the inherent attribute of the semantic node of the power grid model, and its expression is as follows:
If formula (10) is substituted into formula (6), the calculation formula of transfer probability is:
The specific process of TCP Text Rank algorithm is shown in Fig. 1.
It can be seen from Fig. 1 that the specific process of TCP Text Rank algorithm is as follows:

Specific process of TCP text rank algorithm.
Step 1: Input power grid model data;
Step 2: Preprocess the grid model data;
Step 3: Calculate the global importance of the semantic words of the power grid model according to formula (10);
Step 4: Set the sliding window size to ϒ. In the window, the semantic map of the power grid model is constructed through the co-occurrence relationship of the semantic words of the power grid model in the power grid model [19].
Step 5: Calculate the topological potential value of the semantic words of the power grid model based on the global importance of the semantic words of the power grid model and the use formula (10) of the semantic map of the power grid model, as the transfer probability of the semantic words of the power grid model.
Step 6: Construct transfer probability matrix by combining the semantic map of power grid model and transfer probability.
Step 7: Iteratively calculate the weight of the semantic node of the power grid model according to formula (2) until convergence.
Step 8: The semantic words of the power grid model are arranged in reverse order of importance and the keyword set of the power grid model is output.
After extracting the semantic information of the power grid model, the TCP Text Rank algorithm uses the power grid model knowledge fusion method based on the Seq2seq half pointer half label method to improve the power grid model information fusion capability. The structure diagram of the power grid model knowledge fusion model based on the Seq2seq half pointer half label method is shown in Fig. 2.

Structure diagram of a knowledge fusion model for power grid models based on Seq2seq half pointer and half label method.
It can be seen from Fig. 2 that the structure of the knowledge fusion model of the power grid model based on the Seq2seq half pointer half label method uses a single-layer bidirectional LSTM (Bi LSTM) as the model encoder, encodes the original semantics of the power grid model and extracts the semantics of the power grid model, and uses a one-way LSTM as the decoder for decoding operations [20]. For Seq2Seq half pointer half label method model training each step i, corresponding to the original text of the power grid model and the semantic keyword embedding of the extracted candidate power grid model respectively
Thus, the hidden state of the original semantic text of the power grid model can be obtained
At the same time, the hidden state of the extracted grid model semantics can be obtained. The specific formula is as follows:
Then, the encoder hides the output of the layer g
i
from
Then, the attention mechanism [19] is introduced to calculate the hidden state of the decoder s
t
and g
i
correlation between e
it
, the calculation formula is as follows:
Where: tanh() is the activation function; g
i
and s
t
represent the output of the encoder and decoder hidden layers respectively; V, κ
g
, κ
s
and b
attn
are the parameter learned by model training. From η
it
context vector ɛ
t
can be obtained, the formula is as follows:
In this model, firstly, the Seq2Seq model based on attention mechanism is used to construct, and the key semantic information of power grid model is extracted based on the combination of topological potential and TextRank algorithm. Then, in the model coding layer, special characters [SEP] are used to fuse the extracted grid model candidate semantics with the original grid model semantics for information knowledge fusion. The role of special characters [SEP] is to separate the special symbols of discontinuous token sequences, with the purpose of distinguishing the original grid model semantics and extracting the grid model semantics. Then, encoders are used to encode the original power grid model and extract the semantics of the power grid model. Through the encoders, the respective hidden states can be obtained. Then, the corresponding semantic vectors of the power grid model on the hidden layer of the encoder are spliced to achieve information fusion. Then, the fused semantic vectors of the power grid model are sent into the model for training. After training, the model will be able to learn that the content after the [SEP] mark is the extracted grid model text, and extract the effective information to assist in completing the grid model data fusion task.
The power grid model knowledge fusion model encoder based on Seq2seq half pointer half label method is a single-layer bidirectional LSTM. Long and short term memory unit LSTM is an improvement of the common recurrent neural network (RNN). By introducing memory cells into each neuron of the hidden layer, and using three gating units, namely, forgetting gate, input gate, and output gate, to control the state of memory units, it solves the long-term dependence problem of ordinary RNN that cannot learn sequences due to gradient disappearance.
The memory cell memorizes the historical information of sequence data together with the hidden state. The information in the memory unit is controlled by three door control units. The forget gate is based on the hidden state of the previous moment gt-1 and current time input x
t
delete the information in the memory unit. The forgotten door is calculated as follows:
The input gate is hidden according to the previous time gt-1 and current time input x
t
add information to the memory cell, and the calculation formula is shown in formula (22) and formula (23).
After the calculation of forgetting gate and output gate is completed, the memory unit is updated with formula (24).
The output gate is based on the hidden state of the previous time gt-1 input of current time x
t
and the updated memory unit
BeamSearch is mainly used in the Seq2Seq coding stage. Cluster search is a heuristic graph search algorithm [20]. Generally, when the solution space is very large, it will filter out some nodes with poor solution space quality and retain a fixed number of high-quality nodes in each step of depth expansion, thus reducing the space resources occupied by search and improving the time efficiency of search.
In the process of decoding, cluster search t - 1 in the time step, the decoder will track K assumptions, of which K is the preset cluster size, and their corresponding scores are expressed as Z (y1:t-1|x)= log p (y1, y2, ⋯ , yt-1|x). When moving to time t the decoder will expand each hypothesis (expressed as
The score of each hypothesis can be expressed as:
Then, from K × K to choose the one with the highest score among the possibilities K, the others may ignore repeating this process until the decoding process is completed, and improve the data fusion rate of Seq2seq for power grid model through cluster search.
To meet the computational requirements and ensure the smooth running of the experiments, a computer equipped with an Intel Core i9-11900K processor with 32 GB of DDR4 RAM was used, and a 1TB SSD was also mounted. In order to accelerate the training process of the model calculation, NVIDIA GeForce RTX 3080 graphics card is used, which has excellent performance and CUDA support, which is able to significantly shorten the model training time. In terms of software, the Windows 10 operating system was used as the experimental platform. Python version 3.8 is selected as the programming language, and PyTorch 1.9.0 deep learning framework is used to build and train the Seq2seq model.
Taking the substation power grid model in a 220 kV power grid as an example, the specific process of data fusion of substation power grid model data from two different data sources, namely, dispatching automation system OMS and production management system (PMS), is selected to test the practicability of the knowledge fusion method proposed in this paper. The basic data provided by each data source is shown in Tables 1 and 2. In the model training process of this method, the encoder hidden layer uses a single-layer bidirectional LSTM network, the number of hidden units is 256, the word vector dimension is 128, and the decoder hidden layer uses a single-layer unidirectional LSTM network.
From the original data provided in Tables 1 and 2, for the same substation power grid model, the data information provided by different data sources has both mutually repetitive and complementary parts. Even if it is the same basic attribute, the representation of two different data sources are different, so it is necessary to conduct knowledge fusion processing on the original data in the table, so that the description of the basic attributes of the substation power grid model is standardized, the unit is unified, and the data precision is consistent.
Basic Information of substations in OMS
Basic Information of substations in OMS
Basic information of substations in PMS
The method in this paper is used to fuse the grid model data in Tables 1 and 2 to obtain the substation grid model data after data fusion, as shown in Table 3.
Comparing the fused data in Table 3 with the original data in Tables 1 and 2, it can be seen that the data of the substation power grid model after knowledge fusion using this method is more comprehensive, systematic and standardized. The fused basic attributes contain the basic attributes of all data sources, eliminate the redundant parts of the basic attributes of each data source, and the description of each basic attribute is more standardized, unified and perfect. It is proved that the method in this paper is more practical for power grid model data processing.
With the support of the grid model data fusion as the measurement index, the support of the method in this paper is tested when the grid model data dimensions are different. The test results are shown in Fig. 3.
Fused power grid model data
It can be seen from the analysis of Fig. 3 that the support value of the method in this paper when fusing the grid model data decreases with the increase of the grid model data dimension. Before the grid model data dimension is 2, the support of this method when fusing the grid model data is 100%. With the increase of the grid model data dimension, the support when fusing the grid model data is slightly reduced. When the grid model data dimension is 7, the support of this method when integrating the grid model data is about 98%. The results show that the support of the method in this paper is less affected by its dimensions when fusing power grid model data, and the ability of fusing power grid model data is better. These results further verify the practicability and effectiveness of the proposed method. It still maintains a high fusion support degree on high-dimensional data, which shows the superior performance of this method for power grid model data fusion. This also shows that the proposed method can cope well with various dimensions of power grid model data and achieve efficient knowledge fusion in practical power grid modeling applications.

Data fusion test results of power grid model.
In the experimental data set, select 8000 manually labeled triple grid model data, use 80% data training, and 20% data testing. The accuracy rate, recall rate and F1 value are selected as the evaluation indicators of the fusion performance of the test method, and the method in this paper is used to conduct knowledge fusion on the data of the three tuple power grid model. The changes of the accuracy rate, recall rate and F1 value of the training set test set with the number of iterations during model training are obtained, as shown in Fig. 4.
It can be seen from the analysis of Fig. 4 that the method in this paper is used to conduct knowledge fusion on the data of the triple grid model. The model training of the method in this paper is stable after 120 iterations. We further verify the effectiveness of the proposed method through specific quantitative indicators of the experimental results. On the test set, the proposed method achieves an accuracy of 0.98, which reflects its excellent performance in the task of power grid model knowledge fusion. At the same time, the recall rate is 0.93, which means that the proposed method can obtain the key information in the power grid model comprehensively. However, the f1 score reaches 0.91, which further proves that the method achieves a good balance between precision and recall. According to these comprehensive evaluation indicators, we can be sure that the proposed method shows high efficiency and stability in power grid model knowledge fusion. This not only verifies the effectiveness of the method, but also lays a solid foundation for its wide application in the field of power grid modeling.

Changes in metrics during the training of design modol.
When the amount of power grid model data is 10 GB–90 GB, the method in this paper is used for knowledge fusion of power grid model data, and the data processing speed of this method is obtained. The test results are shown in Fig. 5.
It can be seen from the analysis of Fig. 5 that with the increase of the amount of power grid model data, the data processing speed of the method in this paper for knowledge fusion of power grid model data also increases, but the data processing speed is less than 160 s, indicating that the method in this paper for knowledge fusion of power grid model data has faster processing efficiency. This result strongly demonstrates the efficiency of the proposed method. Such a short processing time is actually a very excellent performance when dealing with large-scale power grid model data, which further verifies the superiority of the proposed knowledge fusion method for power grid model data in processing efficiency.

Data processing speed.
The higher the data integrity, the better the data fusion effect. In order to verify the effect of grid model data fusion of the method proposed in this paper, select grid model privacy data for fusion, and analyze the integrity of privacy data. The results are shown in Fig. 6.

Data integrity test results of knowledge fusion method of power grid model based on seq2seq half pointer and half label method.
As can be seen from Fig. 6, with the increase of the number of private data of the power grid model, the data integrity of the method in this paper presents a downward trend. Using the method proposed in this paper, the average integrity of the private data of the power grid model is 98.86%, which shows that the method in this paper has a better effect on the fusion of the private data of the power grid model, can better ensure the data integrity, and has better performance. This result also further shows the potential and value of the proposed method in practical applications. In the face of a large number of private data, this method can not only achieve efficient knowledge fusion, but also maintain high data integrity, which is of great significance for the further development of the power grid modeling field.
The experimental comparison methods are literature [8] method integration evidence data method, literature [9] R multivariable data integration method, literature [10] GIS data integration method, literature [11] knowledge hypergraph data integration method, literature [12] deep learning multi-mode data integration method. When the grid model data volume is 10 GB–90 GB, the methods in this paper, literature [8] method, literature [9] method, literature [10] method, literature [11] method and literature [12] method are used for data fusion of power grid model data with different data volumes, and the mean square error comparison results of several methods are obtained through variance analysis method, as shown in Table 4.
Comparison results of Mean squared error of six methods
According to the experimental results in Table 4, the mean square error of the six grid model data fusion methods is higher than the mean square error of the grid model data fusion before. For the grid models with different data volumes, the mean square error of the grid model data fused with this method is lower than the mean square error of the other five methods, which shows that the fusion accuracy of this method is relatively high. This is mainly because the Seq2seq half pointer and half label method is selected to fuse the data before the fusion in this method, which effectively improves the fusion accuracy. Through this method, the characteristics and information of the original data can be better retained, the information loss in the fusion process can be reduced, and the accuracy of the fusion can be improved.
Combined with the previous experimental results, the proposed method shows superior performance in processing power grid model data fusion. However, just as any method has its limitations, the proposed method is no exception. The performance of the proposed method strongly depends on the quality of the input data. If the input power grid model data has noise, outliers or inconsistencies, it may affect the results of data fusion. Therefore, it is crucial to preprocess and clean the data before applying the proposed method.
In this paper, the problem of power grid model data fusion is studied, and a method based on Seq2seq half pointer and half label is proposed. The effectiveness and superiority of the method are verified by multiple experiments. This study is important to improve the accuracy and reliability of the power grid model. In the research process, the performance of different data fusion methods is compared through experiments, and the processing efficiency, fusion accuracy and private data integrity of the proposed method are analyzed in detail. The experimental results show that the proposed method can still maintain a fast processing speed when dealing with large-scale power grid model data, and also performs well in terms of data fusion accuracy and private data integrity. However, the proposed method still has some limitations, such as the dependence on the quality of the input data. In the future, the robustness of the method will be further improved to cope with the impact of noise and outliers on data fusion. By continuously improving and perfecting these methods, it is expected to achieve higher data fusion accuracy and efficiency in the field of power grid modeling and make greater contributions to the development of smart grid.
Author contribution statement
Yuzhong Zhou initiated the study and Zhengping Lin wrote the review. Four people jointly carried out the experimental research, and Zhengrong Wu recorded and counted the experimental data. Yuzhong Zhou and Zhengrong Wu jointly completed the analysis of experimental data and the writing of experimental contents. Zhengping Lin provided the initial guidance for the paper, and Zifeng Zhang objectively reviewed the paper and contributed to the further improvement and revision of the paper.
