Detection of parking slots occupation by temporal difference of inverse perspective mapping from vehicle-borne monocular camera

Abstract

Detection of parking slots occupation is a crucial task for parking assistance, automatic parking, and autonomous driving systems. This paper proposed a novel method, called Temporal Difference of Inverse Perspective Mapping Difference (TD-IPM), without explicit 3D reconstruction or objection detection. In this method, temporal images from monocular camera are first inverse perspective mapped (IPM) onto the ground plane based on camera calibration results. Second, we proposed an algorithm, called Block Consensus based on Rotation Invariance Phase-Only Correlation (BC-RIPOC), for fast and robust motion estimation. From the estimated motion, we can align these two IPM images and generate IPM difference map. Third, the IPM difference map is segmented and filtered to generate a binary map that can distinguish objects on the ground plane or not for occupation detection. The obstacle is readily localized from the difference map as well. The proposed TD-IPM method has been validated in both underground and outdoor parking lots. Experimental results demonstrate that the proposed TD-IPM method can successfully detect various occupation objects, such as vehicles, cones, lockers, and others, with 97.9% average detection accuracy and speed of 17.5 frames per second (fps). The proposed method suggests an effective and low-cost solution to intelligent parking systems.

Keywords

Autonomous driving parking slot occupation detection inverse perspective mapping temporal images

Get full access to this article

View all access options for this article.

References

Zhu

Rajamani

. Global positioning system-based vehicle control for automated parking. Proc IMechE, Part D: J Automobile Engineering 2015; 220: 37–52.

Jeong

Choi

, et al. Low cost design of parallel parking assist system based on an ultrasonic sensor. Int J Auto Tech 2010; 11: 409–416.

Shao

Chen

Cao

, et al. A Grid projection method based on ultrasonic sensor for parking space detection. In: 2018 IEEE international geoscience and remote sensing symposium (IGARSS), Valencia, Spain, 22–27 July 2018, pp.3378–3381. New York: IEEE.

Lee

Lin

. Vehicle counting based on a stereo vision depth maps for parking management. Multimed Tools Appl 2019; 78: 6827–6846.

Unger

Wahl

Ilic

, et al. Parking assistance using dense motion-stereo. Mach Vis Appl 2014; 25: 561–581.

Lee

Seo

. Available parking slot recognition based on slot context analysis. IET Intell Transp Syst 2016; 10: 594–604.

Imam

David

Adi

MJM

. Implementation of an image processing based smart parking system using Haar-Cascade method. In: 2019 IEEE symposium on computer applications and industrial electronics (ISCAIE), Kota Kinabalu, Malaysia, 27–28 April 2019, pp.222–227. New York: IEEE.

Postigo

Torres

Menendez

, et al. Vacant parking area estimation through background subtraction and transience map analysis. IET Intell Transp Syst 2015; 9: 835–841.

Gkolias

Vlahogianni

. Convolutional neural networks for on-street parking space detection in urban networks. IEEE Trans Intell Transp Syst 2019; 20: 4318–4327.

10.

Zinelli

Musto

Pizzati

, et al. A deep-learning approach for parking slot detection on surround-view Images. In: 2019 IEEE intelligent vehicles symposium (IV), Paris, France, 9–12 June 2019, pp.683–688. New York: IEEE.

11.

Cai

Alvarez

Sit

, et al. Deep learning-based video system for accurate and real-time parking measurement. IEEE Internet Things J 2019; 6: 7693–7701.

12.

Lee

Kim

Lim

, et al. Probabilistic occupancy filter for parking slot marker detection in an autonomous parking system using AVM. IEEE Trans Intell Transp Syst 2019; 20: 2389–2394.

13.

Wang

Mei

Kong

, et al. An approach of lane detection based on inverse perspective mapping. In: 2014 IEEE international conference on intelligent transportation systems (ITSC), New York, NY, 8–11 October 2014, pp.35–38. New York: IEEE.

14.

Zhang

. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 2000; 22: 1330–1334.

15.

. Vision-based position computation from in-vehicle video log images for road sign inventory. IET Intell Transp Syst 2016; 10: 414–420.

16.

Leclerc

Sheng

Arsenault

, et al. Rotation invariant phase-only and binary phase-only correlation. Appl Opt 1989; 28: 1251–1256.

17.

Ranjan

Black

. Optical flow estimation using a spatial pyramid network. In: 2017 IEEE conference on computer vision and pattern recognition, Honolulu, HI, 21–26 July 2017, pp.1–10. New York: IEEE.