Real-time detection of moving objects in a video sequence by using data fusion algorithm

Abstract

The moving object detection and tracking technology has been widely deployed in visual surveillance for security, which is, however, an extremely challenge to achieve real-time performance owing to environmental noise, background complexity and illumination variation. This paper proposes a novel data fusion approach to attack this problem, which combines an entropy-based Canny (EC) operator with the local and global optical flow (LGOF) method, namely EC-LGOF. Its operation contains four steps. The EC operator firstly computes the contour of moving objects in a video sequence, and the LGOF method then establishes the motion vector field. Thirdly, the minimum error threshold selection (METS) method is employed to distinguish the moving object from the background. Finally, edge information fuses temporal information concerning the optic flow to label the moving objects. Experiments are conducted and the results are given to show the feasibility and effectiveness of the proposed method.

Keywords

Moving object detection edge detection optic flow Canny operation security surveillance

Get full access to this article

View all access options for this article.

References

Al-Smadi

Abdulrahim

Abdul Salam

(2016) Cumulative frame differencing for urban vehicle detection. In: 1st International Workshop on Pattern Recognition. Tokyo, Japan, 11–13 May 2016, pp. 100110G. USA: SPIE.

Alvar

Sanchez

Arranz

(2014) Fast background subtraction using static and dynamic gates. Artificial Intelligence Review 41(1): 113–128.

Anandhalli

Baligar

(2015) Improvised approach using background subtraction for vehicle detection. In: IEEE International Advance Computing Conference. Banglore, India, 12–13 June 2015, pp. 240–248. USA: IEEE.

Bruhn

Weickert

Schnorr

(2005) Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods. International Journal of Computer Vision 61(3): 1–21.

Chen

B-H

Huang

S-C

(2014) An advanced moving object detection algorithm for automatic traffic monitoring in real-world limited bandwidth networks. IEEE Transactions on Multimedia 16(3): 837–847.

Fisher

(2001) CAVIAR: Context Aware Vision using Image-based Active Recognition. Available at: http://homepages.inf.ed.ac.uk/rbf/CAVIAR/ (Accessed 3 May 2017).

Haque

Murshed

Paul

(2008) On stable dynamic background generation technique using gaussian mixture models for robust object detection. In: IEEE 5th International Conference on Advanced Video and Signal Based Surveillance. Santa Fe, NM, USA, 1–3 September 2008, pp. 41–48. USA: IEEE.

Heikkilä

Pietikäinen

(2006) A texture-based method for modeling the background and detecting moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(4): 657–662.

Horn

Schunck

(1981) Determining optical flow. Artificial Intelligence,17(1–3): 185–203.

10.

Tan

Wang

et al . (2004) A survey on visual surveillance of object motion and behaviors. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews 34(3): 334–352.

11.

Yang

Zhang

et al . (2017) Moving object detection using tensor-based low-rank and saliently fused-sparse decomposition. IEEE Transactions on Image Processing 26(2): 724–737.

12.

Zhuo

(2014) A moving objects based real-time defogging method for traffic monitoring videos. In: 2014 19th International Conference on Digital Signal Processing, Hong Kong, China, 20–23 August 2014, pp. 1–6. USA: IEEE. Hong Kong: Institute of Electrical and Electronics Engineers Inc.

13.

Huang

Yan

Tan

(2013) A novel method of motion people detection and tracking in moving background. Applied Mechanics and Materials, 373–375: 547–551.

14.

Huang

S-C

Chen

B-H

(2013) Highly accurate moving object detection in variable bit rate video-based traffic monitoring systems. IEEE Transactions on Neural Networks and Learning Systems 24(12): 1920–1931.

15.

Jalal

Kim

Y-H

Kim

Y-J

et al . (2017) Robust human activity recognition from depth video using spatiotemporal multi-fused features. Pattern Recognition 61: 295–308.

16.

Jung

(2009) Efficient background subtraction and shadow removal for monochromatic video sequences. IEEE Transactions on Multimedia 11(3): 571–577.

17.

Kaliraj

Manimaran

(2016) Robust skin color-based moving object detection for video surveillance. Journal of Electronic Imaging 25(4): 043007.

18.

Laptev

Caputo

(2005) Recognition of Human Actions. Available at: http://www.nada.kth.se/cvap/actions/ (Accessed 3 May 2017).

19.

Lee

Mallipeddi

Jang

G-J

et al . (2015) A genetic algorithm-based moving object detection for real-time traffic surveillance. IEEE Signal Processing Letters 22(10): 1619–1622.

20.

Lee

(2014) Low-complexity background subtraction based on spatial similarity. Eurasip Journal on Image and Video Processing 2014(1): 30.

21.

Ding

(2011) A research on improved canny edge detection algorithm. In: 2011 International Conference on Applied Informatics and Communication. Xian, China, 20–21 August 2011, pp. 102–108. Germany: Springer.

22.

Wang

(2010) An optical flow and inter-frame block-based histogram correlation method for moving object detection. International Journal of Modelling, Identification and Control 10(1–2): 87–93.

23.

Lucas

Kanade

(1981) An iterative image registration technique with an application to stereo vision. In Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, British, Columbia, 24–28 August 1981, pp. 121–130.

24.

Mirzamohammad

Ahmadi

Mirzarezaee

(2014) Moving object detection and tracking in video by cellular learning automata and gradient method in fuzzy domain. Journal of Intelligent and Fuzzy Systems 27(2): 929–935.

25.

Ojha

Sakhare

(2015) Image processing techniques for object tracking in video surveillance- A survey. In: 2015 International Conference on Pervasive Computing, Pune, India, 8–10 January 2015, pp. 1–6. USA: IEEE.

26.

Paul

Singh

Midya

et al . (2017) Moving object detection using modified temporal differencing and local fuzzy thresholding. 1–20.

27.

Radzi

SSM

Yaakob

Kadim

et al . (2014) Extraction of moving objects using frame differencing, ghost and shadow removal. In: 5th International Conference on Intelligent Systems, Modelling and Simulation, Langkawi, Malaysia, 27–29 January 2014, pp. 229–234. USA: IEEE.

28.

Ramasubramanian

Rangaswamy

MAD

Reddy

GNVR

(2015) A survey study on detecting and tracking objective methods. In: 2nd IEEE National Conference on Emerging Trends in New and Renewable Energy Sources and Energy Management. Chennai, India, 16–17 December 2014, pp. 159–164. USA: IEEE.

29.

Sengar

Mukhopadhyay

(2016) Moving object area detection using normalized self adaptive optical flow. Optik 127(16): 6258–6267.

30.

Shukla

Saini

(2015) Moving object tracking of vehicle detection: A concise review. International Journal of Signal Processing, Image Processing and Pattern Recognition 8: 169–176.

31.

Siebel

Maybank

(2002) Fusion of multiple tracking algorithms for robust people tracking. In: 7th European Conference on Computer Vision, Copenhagen, Denmark, 28–31 May 2002, pp. 373–387. Germany: Springer.

32.

Stauffer

Grimson

WEL

(1999) Adaptive background mixture models for real-time tracking. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Fort Collins, CO, USA, 23–25 June 1999, pp. 246–525. USA: IEEE.

33.

Stauffer

Grimson

WEL

(2000) Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8): 747–757.

34.

Sun

Shan

Jiang

et al . (2016a) An ensemble framework for object detection in intelligent video surveillance system. International Journal of Control and Automation 9(2): 239–248.

35.

Sun

Y-C

Geng

G-H

(2016b) Moving object detection algorithm based on frame difference and background subtraction. Jilin Daxue Xuebao (Gongxueban) 46(4): 1325–1329.

36.

The University of Reading, UK (2001) The PETS2001 datasets. Available at: http://ftp.pets.rdg.ac.uk/ (Accessed 3 May 2017).

37.

Verma

Kumar

Tomar

(2015) Analysis of moving object detection and tracking in video surveillance system. In: 2nd International Conference on Computing for Sustainable Global Development. New Delhi, India, 11–13 March 2015, pp. 1758–1762. USA: IEEE.

38.

Wang

(2015) An improved Canny algorithm with adaptive threshold selection. In: International Conference on Engineering Technology and Application, Xiamen, China, 2015, pp. 01017-p.1–01017-p.7. France: EDP Sciences.

39.

Xin

Hou

Dong

et al . (2014) A self-adaptive optical flow method for the moving object detection in the video sequences. Optik-International Journal for Light and Electron Optics, 125(19): 5690–5694.

40.

Yang

Lei

et al . (2017) A dense flow-based framework for real-time object registration under compound motion. Pattern Recognition 63: 279–290.

41.

Zhang

Thomas

et al . (2014) Moving people tracking with detection by latent semantic analysis for visual surveillance applications. Multimedia Tools and Applications 68: 991–1021.

42.

Zhou

Zhang

(2005) Modified GMM background modeling and optical flow for detection of moving objects. IEEE Systems, Man and Cybernetics Society, Proceedings – 2005 International Conference on Systems, Man and Cybernetics, Waikoloa, HI, USA, 12–12 October 2005, pp. 2224–2229. USA: IEEE.

43.

Zhou

Yang

(2013) Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(3): 597–610.