Kalman tracking algorithm of ping-pong robot based on fuzzy real-time image

Abstract

The moving target tracking is a very important in computer vision research topic and is widely used, it is of great research significance, has been widely used, and involved in image recognition, production automation, intelligent pattern recognition, artificial intelligence, weather information, and other fields, but in some high speed movement, such as target under complex background target trajectory when not much target tracking is still more difficult. This paper mainly studies the Kalman tracking algorithm of ping-pong robot based on fuzzy real-time image. For table tennis high-speed motion blurred images, air resistance and the camera imaging distortion caused by factors such as the error problem, puts forward an adaptive measurement covariance discrete Kalman trajectory estimation algorithm. The algorithm with dynamic adjustment of measuring the size of the covariance, has realized the accurate tracking of the target motion trajectory, and further laid the groundwork for table tennis balls prediction and hitting arm. The experimental results show that the algorithm can effectively overcome the interference of measurement noise and data loss and give excellent tracking results when the image acquisition rate is higher than 70 frames /s and the table tennis speed is higher than 5 m/s.

Keywords

Fuzzy ecognition ping-pong robot real-time tracking image recognition Kalman filtering

1 Introduction

Computer vision is not only an important and challenging research topic in the field of engineering, but also in the field of science, and the tracking of moving objects in video is an important part of computer vision [1]. Video moving object tracking is a blend of many areas of advanced technology such as military and civilian, including image processing, automatic control, artificial intelligence, pattern recognition, medical diagnosis, etc., it in military visual guidance, robot visual navigation, security monitoring, public scene monitoring, intelligent transportation and many other aspects have a wide range of applications, it also makes many researchers at home and abroad has been committed to the technology research [2, 3]. However, due to the influence of many factors such as illumination change, noise, occlusion and homology, the existing algorithms are faced with many problems in practical application. Therefore, it is still extremely challenging to study and design reliable and universal moving target tracking methods [4, 5]. Table tennis robot is a new kind of real-time intelligent robots, it is a good model to study hand eye coordinated visual servo control in robot field, only 20 years of history. The application of computer vision technology, equivalent to the “eyes” of table tennis robot, plays an important role in the construction of the whole robot system [6, 7]. More specifically, computer vision technology by real time identification and tracking of table tennis trajectories, early prediction of table tennis balls and rebound after the movement, so as to guide the arm movement servo mechanism to complete the punch [8, 9]. Currently, robot visual trajectory estimation algorithms can be basically divided into two categories: one is based on template matching estimation algorithms, such as histogram matching, background estimation; Another kind is based on the kinematics model of trajectory estimation methods, such as the particle filter, Kalman filtering algorithm [10]. However, the actual real-time trajectory tracking still exist many difficulties, such as table tennis high-speed motion blurred images taken by air drag, flight of the ball itself and the camera imaging distortion factors, lead to direct results of measurement are usually deviated from the true trajectory [11, 12]. At the same time, the speed of table tennis exceeds 5 m/s, and the acquisition speed of the camera reaches 70 frames /s. However, traditional visual tracking technology generally has an image processing speed less than 30 frames /s, which cannot meet the real-time requirements of table tennis robot [13].

This paper innovation points: (1) Through the analysis of the moving target detection technology research, including two frames difference method, three frame difference method, background difference method and mathematical morphology method, puts forward a set of with three frame difference method to detect the target first, obtain the target color characteristics, using mathematical morphology operation correction has detection target detection method, can obtain better effect of moving target detection; (2) The function of Kalman filter to predict the target and to modify the prediction results was analyzed and studied, and the adaptive factor was proposed to realize the self-adaptability of Kalman filter in the process of moving target tracking. (3) In view of the target in the process of moving target tracking speed in the air, with the air resistance, magnus force (for table tennis rotating in the air force) of the influence of interference, the actual trajectory and ideal trajectory deviation problems, designs and realizes a kind of based on adaptive Kalman filtering algorithm, this algorithm can improve the effectiveness of the target tracking and enhance adaptability in traditional Kalman filter in target tracking.

Firstly, this paper introduces the research work and Kalman filter theory. The second part mainly introduces the use of experimental tools, experimental arrangement and data collection methods. In the third part, based on the experimental data, the practical problems of a discrete Kalman filter estimation algorithm for adaptive covariance measurement are analyzed. The fourth part summarizes the research of the whole paper.

2 Proposed method

2.1 Related work

Gupta studied the development and implementation of a new robust vision controller for humanoid robots. The vision controller is composed of two parts: 1) robust algorithm, which can track people’s line of sight in its camera view; 2) servo controller, which generates necessary motion commands so that the robot can follow the target person. Tracking algorithms use point-based features (such as robust features for acceleration) to detect people under challenging conditions, such as changes in light, posture, complete or partial occlusion, and sudden camera movement. His innovative contributions to the tracking algorithm include: 1) dynamic object model, which develops over time to cope with short-term changes while maintaining stability in the long term; 2) the online k-d tree-based classifier and kalman filter are used to distinguish the situation of attitude change and the situation of partial or complete occlusion; 3) he proposed a method to detect postural changes caused by rotation outside the plane, which was a difficult problem and led to frequent tracking failures of human follow-up robots. He proposes an improved version of a visual servo controller that uses feedback linearization to overcome the vibration in previously used slide-mode based controllers. Through various simulation and actual experiments on the actual mobile robot platform, he proved the effectiveness of the method he proposed [14, 15]. Yang proposed a new nonlinear predictive control strategy based on extreme learning machine to solve the path tracking control problem of wheeled mobile robot with external disturbance. Hybrid chaotic optimization algorithm (HCOA) can be used to solve the real-time nonlinear minimization problem of the cost function of mobile robot. The algorithm can avoid falling into local minima and improve the convergence and control accuracy when dealing with large space and high-dimensional optimization problems. His proposed improved bidirectional extreme learning machine is used to model the mobile robot factories and estimate future factory output. The experimental results of the tracking automatic mobile robot studied by him show that compared with the traditional neural network prediction controller, this controller can provide higher accuracy and faster tracking performance [16, 17]. Based on the fact that the motion of a rotating ball can be divided into translational motion and rotation relative to the center of the ball, Zhang proposed a novel visual system that can provide a high-precision mode of real-time position and rotation information of the flying ball. He used a frame-based approach to identify the natural brand of the ball under normal lighting conditions. You can then restore the ball’s 3D position in spherical coordinates. Through observation and analysis, he found that the axis and angular velocity of spin did not change during flight, and he could use the plane fitting method based on the consensus of weighted random samples to estimate the spin state. By combining the position information and rotation information in the dynamic model based on force, the extended kalman filter can achieve accurate trajectory prediction. His experimental results have proved the validity and accuracy of this method [18, 19]. Elsheikh proposed a practical model-free path planning and path tracking algorithm, which uses multiple cameras and decentralized fuzzy logic controller for a non-integrated indoor wheeled mobile robot. His algorithm is divided into three stages. The first stage uses the multi-template fast moving (MSFM) path planning method. In general, the path generated by the direct execution of the fast moving method is not guaranteed to be safe or smooth. The robot can then touch corners, walls and other obstacles. Based on the size of the robot, the algorithm adds a preprocessing stage before MSFM programming method to solve such problems. The second phase uses visual information extracted from images captured by multiple cameras to estimate the position and direction of the mobile robot in each frame. In the third stage, a decentralized control strategy is used to connect three identical proportional differential fuzzy logic controllers (PD FLC) in parallel as a path follower to keep the robot in the desired path. His research results show that the design he developed can effectively estimate the shortest path, avoid obstacles and guide the robot to track the path in real time [20, 21].

2.2. Kalman filtering theory

(1) Kalman filter

Kalman filtering algorithm is the most widely used in modern target filtering system, and most other derived algorithms are developed on the basis of kalman filtering. Discrete kalman filter was first proposed, which overcame the application defects of wiener filter. After that, continuous time kalman filter was popularized, which completely solved the engineering implementation problem of the filter algorithm. Kalman algorithm is an optimal condition estimation algorithm, its basic principle is linear, unbiased, minimum error variance. The essence of this method is to use the recursive data processing method to obtain new state estimates from the measured values obtained from the system through the determined recursive equation. In kalman filter algorithm, white noise is applied to the whole system signal process and produces a linearized output result. The kalman algorithm contains several statistical properties, which are obtained by the combination of the state space equation that represents the target model, the observation equation that represents the filter estimation characteristic, and the observation noise and the system noise. Therefore, kalman filter algorithm can estimate one – dimensional and multi – dimensional processes as well as stationary and non – stationary processes. Based on kalman theory, after years of research, many derived filtering algorithms have been developed and achieved good filtering effects, and their application scope has been extended to navigation, communication, seismic detection, mineral development, biomedicine and other aspects. Compared with other types of filtering algorithms, kalman algorithm has the following three significant characteristics: one is that the algorithm has two forms of continuous and discrete, and can be analyzed in the time domain, and the computer can directly implement the discrete algorithm; the second is algorithm recursion, which continuously obtains new state estimation through recursive equation. The measurement information at different moments does not need to be stored by the computer, and the estimation information at the current moment can be obtained in real time. The statistical characteristics of the estimated parameters can be determined by the statistical characteristics of the input noise and the system state equation. Based on the above three characteristics, compared with other kalman filtering algorithm is more widely used in target tracking, and has the following advantages: (1) the system can gain access automatically by the algorithm, so the universal applicability of the kalman algorithm is stronger, through partial parameters change, the same filter design can be applied to other models; (2) the covariance matrix can be used to conveniently measure the estimation accuracy. Meanwhile, in non-single target tracking, the formation of tracking gate and the determination of threshold can be measured and obtained by this method. (3) the residual (novelty) in kalman filter can be used as a means of target maneuver detection and identification. Through the consistency analysis of the change of residual (novelty), we can determine whether the approximate target motion model is reliable and consistent with the real motion characteristics of the target. (4) during the tracking and detection process, kalman gain sequence can be adaptively adjusted according to the change of state, so as to achieve the optimal filtering effect.

Kalman filter is a method to estimate the expected signal according to the model and observation of the filter signal. This method introduces the concept of state space in stochastic estimation theory and treats signal processing as the output of linear system under the action of white noise. The equation describing the relationship between input and output is called the equation of state. A recursive algorithm occurs when a state estimate of the current time requires measurements of the previous time. A very simple and convenient feature of recursive algorithm is that it allows serialization of the received data instead of batch processing, so we don’t need to store all the data, and we don’t need to re-process the existing data when the data is updated. Kalman filter is a real – time recursive algorithm for stochastic signal estimation. The filter estimates the random signal by observing the input system and takes the estimated signal as the output of the filter. The observation update and time update algorithms determine the input and output of the filter. According to the statistical characteristics of system noise and observation noise, the observation equation and system state equation are used to estimate the filter signal [22].

Kalman filter describes the system through dynamic equation and observation equation. Even without knowing the exact nature of the model, it can use the past of the signal to correct the current state and even estimate the future state. The initialization of kalman filter is relatively simple. It can start at any point. The finite order filtering operation can accurately estimate the real position of the target, and the estimation of the future motion state can be continuously modified by using the actual motion parameters. The recursive filtering method is used for calculation, which has the characteristics of small computation amount, strong real-time performance and optimization of state space model through computer program. The principle is shown in Fig. 1.

Fig. 1

The filter loop of the Kalman filter.

The mathematical model of kalman filter is first order differential equation, not high order differential equation. Both continuous and discrete systems are first order differential equations, especially in computer processing. For each filter calculation, only the estimation data of the previous moment and the current observation data can be used to estimate the estimation value of the next moment [23]. The recursive nature of kalman filter is very suitable for computer operation, because it does not need to store historical data, reducing the need for computer storage. In target tracking, kalman filter is used to predict the target position as the starting point of Camshift iteration process, which greatly reduces the number of iterations and thus improves the computing speed.

(2) Kalman filter basic equation of random linear discrete system.

The process of kalman filter is described by difference equation and discrete observation equation with random initial state, observation noise and process noise. Without considering the control effect, the equation of random linear discrete system is $X_{k} = {AX}_{k - 1} + {BU}_{k - 1} + W_{k - 1}$ (1) $Z_{k} = {HX}_{k} + V_{k}$ (2)

State variable X ∈ Rⁿ, observation variable Z ∈ R^m, random signal V_k and W_k represent observation noise and system process noise respectively. Assuming that they are mutually independent and normally distributed white noise, the statistical characteristics of observed noise and system process noise are shown in formula (3).

$\begin{matrix} E [W_{k}] = 0, E [W_{k} W_{j}^{T}] = Q_{k} δ_{kj} \\ E (V_{k}) = 0, E [V_{k} V_{j}^{T}] = R_{k} δ_{kj} \\ E [W_{k} V_{j}^{T}] = 0 \end{matrix}$ (3)

Where, Q_k is the p×p dimensional symmetric non-negative definite variance matrix of system process noise W_k; R_k is systematic observation.

The m×m dimension symmetric positive definite variance matrix of noise R_k; δ_kj is the Kronecker function.

Kalman filter consists of measuring updating equation and time updating equation. The modified posteriori estimate is obtained by combining the calculated observed variables with the prior estimate by using the measurement update equation, and the result of the posterior estimate is taken as the prior estimate of the state at the next moment. The value of the error covariance and the current state variable are deduced by using the time updating equation. To sum up, kalman filter estimates the state of the system through real-time correction: first, the state of the system at a certain moment is estimated through the time update equation, and then the observed variables are measured through the update equation to correct the estimated state of the system.

The observed value at moment k is Z_k, and the optimal state estimation X_k-1 of ${\hat{X}}_{k - 1}$ at moment k-1 has been obtained. According to equations (1) and (2), the basic Kalman filter equation of random linear discrete system can be obtained, and its state prediction equation is: ${\hat{X}}_{k}^{-} = A {\hat{X}}_{K - 1} + {BU}_{K - 1}$ (4)

Covariance equation for prediction state $P_{K}^{-} = {AP}_{K - 1} A_{K}^{T} + Q$ (5)

Filter gain equation $K_{K} = P_{K}^{-} H^{T} {({HP}_{K}^{-} H^{T} + R)}^{- 1}$ (6)

State optimization estimation equation ${\hat{X}}_{K} = {\hat{X}}_{K}^{-} + K_{K} (Z_{K} - H {\hat{X}}_{K}^{-})$ (7)

Covariance equation of state optimization estimation $P_{K} = (I - K_{K} H) P_{K}^{-}$ (8)

Where, Equation (5) can be further written as $K_{K} = P_{K} H^{T} R^{- 1}$ (9)

Equation (7) can be further written $P_{K} = P_{K}^{-} + H^{T} R^{- 1} H$ (10)

As shown in Fig. 2, it is the block diagram of Kalman filter of random linear discrete system obtained from Equations (4) and (7). The observed variable is the input signal of the filter, and the obtained optimization estimate is the output signal of the filter.

Fig. 2

Block diagram of Kalman filter for random linear discrete system.

Using the posterior estimate calculated by the system observation equation and time update equation as the next prior estimate, the whole recursive process is repeated. The recursive repetition of Kalman filter determines that it is more time efficient than other filters. It only needs recursion based on the current state estimation of the observed variable and the posterior estimation of the previous point, which is simple to realize [24].

Another representation of kalman filter algorithm is shown in Fig. 3. The kalman filter algorithm is divided into two parts: measurement update and time update. Where the error covariance can be calculated independently, ${\hat{X}}_{k - 1}$ and P_K-1 are the initial estimates.

Fig. 3

Flow chart of Kalman filter algorithm.

(3) Characteristics of Kalman filtering algorithm

By analyzing and studying the basic equation of Kalman filter for stochastic linear discrete system, the algorithm equation is summarized to have the following characteristics:

1) Kalman filter is the signal process of desired signal continuous prediction and correction, filtering equation is a recursive algorithm based on time axis, don’t need to store large amounts of data in the calculation process, as long as there is a new measurement data, a new prediction can be calculated, so the kalman filter algorithm has less amount of calculation, and high real-time performance, the advantages of easy to computer implementation.

2) Kalman filter can be regarded as a linear system under the action of random white noise and random signal and the signal is the system input and output [25], but the relationship between the input and output based on the measuring equation and state equation, thus the filter method is not only applicable to stationary random signal filtering, also applies to gauss – markov sequences such as filtering, application scope is very broad.

2.3 Target tracking algorithm

(1) Feature-based tracking method

In the two consecutive frames of images in video, there are a lot of feature information of moving targets. Since the time interval between frames is very short, it can be considered that the feature information of these targets is constant for a period of time, and it can effectively track moving targets according to the feature information. In this way, even if the target is partially occluded, the problem of the target being partially occluded can still be solved according to the feature information contained in the whole target. In this paper, CamShift tracking algorithm based on features is studied. The feature-based tracking method has its obvious advantages: (1) Iin the tracking process, the target features are easy to be detected and can be well matched with the target features; (2) Because the establishment is a simple feature model, and feature information has a short time stability, so the tracking algorithm based on features is relatively simple; (3) Because the established feature models are independent of each other, it is not necessary to consider the shape and size of the target in the process of target tracking. But it also has its significant disadvantages: (1) If the target is simple but the background is complex, it will affect the accuracy of target feature information extraction; (2) The nonlinearity of the target characteristic parameters leads to the fact that the recovered characteristic parameters in the target tracking are easily affected by noise; (3) If the target is blocked at the initial moment, it is difficult to initialize the target features. Therefore, the effectiveness of the target tracking method based on features is greatly affected by the accuracy of the initial feature information, and the target tracking algorithm will become more complicated due to external interference.

(2) Tracking method based on active contour

The edge contour feature of moving target can provide the target feature information independent of the shape and motion of the target. Snake algorithm is an effective detection and tracking algorithm. It uses external force, binding force and internal force to make the curve move towards the target contour. A curve is considered a curve when it stops moving, is the outline of the target being tracked. Since this method is based on the global information of the target contour, no prior knowledge of the moving target is needed to obtain the contour curve, so it is widely used in target tracking, image segmentation and edge detection. However, the snake model also has some disadvantages: 1. The initial contour should not be too far from the real edge of the target, otherwise the tracking results will be inaccurate. Traditional model cannot get the curve of the deep concave part of the target. Active contour algorithm includes two algorithms: geodesic active contour and parametric active contour. The mathematical model of geodesic active contour uses the level set method to represent the curve in the high-dimensional space, which only contains the parameters related to the curve geometry, while the parametric active contour uses the contour parameters to represent the motion curve. Compared with the geodesic active contour model, the parametric active contour model must be controlled by the outside or given the initial value, while the geodesic active contour model can adjust the geometric changes of curves in the process of motion without any assistance from the outside conditions. Active geodesic contour model is more suitable for multi-motion target tracking.

(3) 3D based tracking method

The motion target tracking method based on 3D is to use the camera to shoot different angles of the target in the scene, so that the 3D model with a complete geometric shape becomes a plane image, and the tracking is realized according to the change of the model position in the image. In the XTRACK system, the position of the vehicle is obtained by detecting the initial frame in the video sequence image by optical flow method, and the detected target position is compared with the reference point initially set in the system, so as to calculate the speed and direction of the target. Its initial angular velocity is obtained through a multidimensional vehicle model. The moving object tracking method based on 3D can recover the 3D model of moving object based on plane image, which has been widely applied in the moving object tracking system of video. The 3d-based tracking method can make good use of the results of model knowledge to track moving objects in complex scenes, but it has the disadvantages of poor real-time performance and heavy workload.

(4) Tracking method based on motion estimation

Moving target tracking based on motion estimation is one of the most widely used methods in target tracking. The motion parameters in the moving target tracking method based on motion estimation are obtained by optical flow detection, which mainly includes two methods: global optical flow field and feature point optical flow field. Compared with the global optical flow field method, the optical flow field of feature points can obtain the target position only by matching the target features, which has the characteristics of high real-time performance and small computation. However, because the optical flow field is based on feature points, it is difficult to obtain the global information of moving targets. In general, the estimation feature information of moving target may not be accurate and reliable due to occlusion, shadow, and change of light source, monochromatic interference and noise. In addition, the existing optical flow algorithm has poor real-time performance and high complexity. Unless there is special hardware support, it is difficult to realize the real-time detection of moving objects [26].

3 Experiments

3.1 Experimental design

The real device used in this experiment is shown in Fig. 4. The robot adopts monocular vision and motion servo joints with 7 degrees of freedom developed by the robot. R_k is according to the result of camera calibration, set to measure the maximum error. In this experiment, R_k initial value is set to 10 mm, with the decrease of the d_k, R_k value increased gradually to about 40 mm. This equipment uses the camera and the BALS – ER company A602FC series of color digital camera, win – dows XP operating system, CPU for P4 2 · 6 GHz), OK_C30A image acquisition card.

Fig. 4

Table tennis robot.

3.2 Data collection

The experimental data in this paper are realized by camera. During the ping-pong test of the ping-pong robot, the scene was photographed and the images were processed by the computer at a high speed to complete the field experiment. In order to speed up the time of image positioning algorithm, camera keyhole perspective model (a simple linear geometric perspective model) was adopted for the experimental data acquisition in this paper.

4 Discussion

4.1 Analysis of Kalman tracking algorithm of ping-pong robot based on fuzzy real-time image

(1) Analysis of tracking effect

As shown in Fig. 5, describes the ping-pong X axis direction of the speed v tracking results. As can be seen from the Fig. 4, adaptive measurement covariance of the Kalman filter initial tracking phase (solid line) and conventional Kalman filter (dashed line) are set up relatively small measurement covariance, therefore the filter output almost no obvious differences. But as time goes on, the measurement of adaptive covariance of the Kalman filter covariance increases gradually, and the tracking results tend to be stable, and the output of the general Kal – man filter noise larger all the time, not convergence.

Fig. 5

X-axis velocity tracking results.

(2) Analysis of anti-noise interference ability

As shown in Fig. 6, the anti-jamming performance of filter, is a important index to measure real-time visual tracking. As the experimental results verify the algorithm in this paper, the original measurement data with another in the field of digital filtering algorithms for filtering – sliding window filtering algorithm were compared. Figure 6 depicts introduce noise in the process of Z axis measurement of speed tracking curve. As shown in Fig. 6, in the time of 200 Ms nearby, introduced the measurement noise signal, the results of measurement are usually deviated from the actual trajectory, differential speed performance for larger disturbance (as shown in the upper point of a circle). From the curve analysis, adaptive measurement covariance of the Kalman filter (solid line) can more effectively suppress the noise impact on output, less volatile, in contrast, with a dotted line sliding window filter output curve near the disturbance of the emergence of a large pulse jitter [27]. Therefore, in this paper, the method has a better anti-jamming ability.

Fig. 6

Tracking results after adding noise.

(3) Image and light interference analysis

Due to reasons such as image processing, light or shade, unable to get the accurate information of table tennis, means that data loss may occur. Figure 7 are analyzed in this case the tracking results. As shown in Fig. 7, in 150 ms to 210 ms, no any measurement signal input, then from the point of speed tracking curve, adaptive measurement covariance Kalman filtering algorithm for data loss, has better ability to adapt, the output is relatively smooth, and the output of the sliding window filtering algorithm has larger dithering.

Fig. 7

Data loss tracking results.

(4) Analysis results of calculated quantity

As shown in Fig. 8, it is the curve diagram of the target center point obtained by the original algorithm and the improved algorithm after the moving ping-pong ball encounters the same color interference. Table 1 still shows the absolute error between the center point position of the tracking target and the true value.

Fig. 8

Coordinates of target center point with or without the same color interference processing.

Table 1

Absolute error of target center point coordinates before and after the improvement of tracking algorithm

	Target true center point coordinates	Algorithm before the target center point coordinates	Target center point coordinates after algorithm improvement	Absolute error/pixel before algorithm improvement	Absolute error/pixel after algorithm improvement
Frame 5	(58,120)	(58.5,132)	(58.5,171)	2.7	2.1
Frame 30	(168,102)	(159,114.50)	(157,121.50)	8.13	5.18
Frame 55	(171,112)	(221,144)	(169,123)	46.49	12.11
Frame 77	(247,113)	(215.5,153.5)	(237,114)	58.69	21.03
Frame 98	(283,115)	(203,167)	(269.5,113.5)	90.36	17.49

5. Conclusions

In this paper, a new and representative ping-pong robot in the field of robotics is adopted as the research object, and a high-speed flying ping-pong (5 m/s) is taken as the tracking target. An adaptive tracking algorithm based on Kalman filtering to measure covariance is constructed to process the results of image acquisition by high-speed digital camera (70 frames /s). Experimental results show that the algorithm has good accuracy and convergence speed, and can be applied to real-time image tracking and video processing.

This paper proposes a discrete Kalman filter estimation algorithm for adaptive measurement of covariance, which dynamically adjusts the size of measurement covariance in different stages of track tracking, which not only ensures the rapidity and convergence of state tracking in the initial stage, but also meets the requirements of real-time performance and stability, and has a good tracking effect. In this paper, a moving target detection and tracking system is designed, but it is only a simple target detection and tracking system, and there is still a big gap from the requirements of a perfect video monitoring system, which needs to be further improved.

Video moving object tracking involves pattern recognition, artificial intelligence, image processing, and other emerging disciplines, in the current market integration and economic globalization situation, more and more abundant demand growing perception, cognition, must make video moving object tracking technology to a more in-depth study stage, get more extensive application. In real life, sports contain a lot of meaningful visual information, such as robot walking positioning, traffic flow detection, safety of important places, guidance of aviation and military aircraft, automatic or assisted driving of cars and so on. Therefore, this real-time motion tracking method has a broad application prospect.

References

Huang

C.H.

, Lee

L.H.

and Ho

C.C.

, Real-time rfid indoor positioning system based on kalman-filter drift removal and heron-bilateration location estimation, IEEE Transactions on Instrumentation & Measurement 64(3) (2015), 728–739.

Cardoso

, Ferreira

and Silva

, Kalman filter approach for estimating water level time series over inland water using multi-mission satellite altimetry, Hydrology & Earth System Sciences Discussions 12(5) (2015), 4813–4855.

Cheng

W.Y.Y

and Steenburgh

W.J.

, Strengths and weaknesses of mos, running-mean bias removal, and kalman filter techniques for improving model forecasts over the western united states, Weather & Forecasting 22(6) (2015), 1304–1318.

Rezig

, Toscano

and Rusaouën

, Fuzzy kalman filter for 3d lagrangian particle tracking using multi-scale bubble detection, Energy Procedia 78(27) (2015), 3078–3083.

Dimeas

, Avendañovalencia

L.D.

and Aspragathos

, Human – robot collision detection and identification based on fuzzy and time series modelling, Robotica 33(9) (2015), 1886–1898.

Cao

, Yang

and Zhong

, Fast polarization-state tracking based on radius-directed linear kalman filter, Optics Express 23(15) (2015), 19673.

Shaowu , Shi and Liwei , Sensors, A Kinect-based real-time compressive tracking prototype system for amphibious spherical robots, Sensors 15(4) (2015), 8232–8252.

Yoshioka

, Phuong

T.T.

and Yabuki

, High-performance load torque compensation of industrial robot using kalman-filter-based instantaneous state observer, Ieej Journal of Industry Applications 4(5) (2015), 589–590.

Shemelin

, On boundaries of ping-pong modes in multipacting, Physics of Plasmas 25(5) (2018), 053105.

10.

Gulalkari

A.V.

, Pratama

P.S.

and Hoang

, Object tracking and following six-legged robot system using Kinect camera based on Kalman filter and backstepping controller, Journal of Mechanical Science & Technology 29(12) (2015), 5425–5436.

11.

Lin

C.L.

, Chang

Y.M.

and Hung

C.C.

, Position estimation and smooth tracking with a fuzzy-logic-based adaptive strong tracking kalman filter for capacitive touch panels, IEEE Transactions on Industrial Electronics 62(8) (2015), 5097–5108.

12.

Bin

M.A.

, Wang

and Xie

, Robust vertical handoff algorithm based on decision tree in vehicle heterogeneous network, Journal of Electronics & Information Technology 39(7) (2017), 1719–1726.

13.

Wang

, Zhang

and Chen

, Real-time monitoring of pollutant diffusion states and source using fuzzy adaptive kalman filter, Water Air & Soil Pollution 229(7) (2018), 238.

14.

Gupta

, Kumar

and Behera

, A novel vision-based tracking algorithm for a human-following mobile robot, IEEE Transactions on Systems Man & Cybernetics Systems 47(7) (2017), 1415–1427.

15.

, Ping

and Di

, Online robot calibration based on hybrid sensors using Kalman Filters, Robotics & Computer Integrated Manufacturing 31(C) (2015), 91–100.

16.

Yang

, Lin

and Miao

, Predictive control strategy based on extreme learning machine for path-tracking of autonomous mobile robot, Intelligent Automation & Soft Computing 21(1) (2015), 1–19.

17.

, Zhang

and Guo

, Multi-sensor Ensemble Kalman filtering algorithm based on observation fuzzy support degree fusion, Optik – International Journal for Light and Electron Optics 127(20) (2016), 8520–8529.

18.

Zhang

, Rong

and Zhao

, Real-time spin estimation of ping-pong ball using its natural brand, IEEE Transactions on Instrumentation & Measurement 64(8) (2015), 2280–2290.

19.

Long

, Du

and Wang

, Control and experiment for exoskeleton robot based on Kalman prediction of human motion intent, Jiqiren/Robot 37(3) (2015), 304–309.

20.

Elsheikh

E.A.

, El-Bardini

M.A.

and Fkirin

M.A.

, Practical design of a path following for a non-holonomic mobile robot based on a decentralized fuzzy logic controller and multiple cameras, Arabian Journal for Science and Engineering 41(8) (2016), 3215–3229.

21.

Luo

, Zou

and Yang

, Grape image fast segmentation based on improved artificial bee colony and fuzzy clustering, Nongye Jixie Xuebao/Transactions of the Chinese Society of Agricultural Machinery 46(3) (2015), 23–28.

22.

Wang

, Li

and Liu

, Analysis of feature fatigue eeg signals based on wavelet entropy, International Journal of Pattern Recognition and Artificial Intelligence 32(08) (2018), 1854023.

23.

Chen

C.H.

, Hwang

F.J.

and Kung

H.Y.

, Travel time prediction system based on data clustering for waste collection vehicles, Ieice Transactions on Information and Systems 102(7) (2019), 1374–1383.

24.

Liu

, Li

and Wang

, Multi-view hierarchical bidirectional recurrent neural network for depth video sequence based action recognition, International Journal of Pattern Recognition and Artificial Intelligence 32(10) (2018), 1850033.

25.

Wang

, Wang

and Zhang

, Robust signal recovery with highly coherent measurement matrices, IEEE Signal Processing Letters 24(3) (2016), 304–308.

26.

Tang

, Li

, Wang

, Chen

, Feng

, Zou

and Huang

, Real-time detection of surface deformation and strain in recycled aggregate concrete-filled steel tubular columns via four-ocular vision, Robotics and Computer-Integrated Manufacturing 59 (2019), 36–46.

27.

Wang

, Huang

, Zhang

and Wang

, Group sparse recovery in impulsive noise via alternating direction method of multipliers, Applied and Computational Harmonic Analysis; 2019.