The ability to automatically recognize human faces based on dynamic facial images is important in security, surveillance and the health/independent living domains. Specific applications include access control to secure environments, identification of individuals at a particular place and intruder detection. This research proposes a real-time system for surveillance using cameras. The process is broken into two steps: (1) face detection and (2) face recognition to identify particular persons. For the first step, the system tracks and selects the faces of the detected persons. An efficient recognition algorithm is then used to recognize detected faces with a known database. The proposed approach exploits the Viola-Jones method for face detection, the Kanade-Lucas-Tomasi algorithm as a feature tracker and Principal Component Analysis (PCA) for face recognition. This system can be implemented at different restricted areas, such as at the office or house of a suspicious person or at the entrance of a sensitive installation. The system works almost perfectly under reasonable lighting conditions and image depths.
AhadMd. A.R., Computer vision and action recognition: A guide for image processing and computer vision community for action understanding, Atlantis/Springer, 2011.
2.
RangaswamiR., DimitrijevicZ., KakligianK., ChangE. and WangY.-F., The SfinX video surveillance system, IEEE Conference on Multimedia and Expo, (2003).
3.
HeilmannE., Video surveillance and security policy in France: From regulation to widespread acceptance, Information Polity16 (2011), 369-377.
4.
RätyT.D., Survey on contemporary remote surveillance systems for public safety, IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews40 (2010), 493-515.
5.
PaolaD.D., MilellaA., CicirelliG. and DistanteA., An autonomous mobile robotic system for surveillance of indoor environments, International Journal of Advanced Robotic Systems7 (2010), 19-26.
6.
ZhangJ., SongG., QiaoG., MengT. and SunH., An indoor security system with a jumping robot as the surveillance terminal, IEEE Transactions on Consumer Electronics (2011), 57.
7.
ChamasemaniF.F. and AffendeyL.S., Systematic review and classification of video surveillance systems, International Journal of Information Technology and Computer Science7 (2013), 87-102, ISSN 2074-9007, ESSN: 2074-9015.
8.
TorresL., LorenteL. and VilàJ., Face recognition using self-eigenfaces, in: International Symposium on Image/Video Communications Over Fixed and Mobile Networks, Rabat, Morocco, (2000), 44-47.
9.
ViolaP. and JonesM.J., Robust real time face detection, International Journal of Computer Vision57(2) (2001), 137-154.
10.
PapageorgiouC., OrenM. and PoggioT., A general framework for object detection, in: International Conference on Computer Vision, (1998).
11.
YanT., WangY., ZhuZ. and JiQ., Robust facial feature tracking under varying face pose and facial expression, Pattern Recognition40(11) (2007), 3195-3208.
12.
NishinaY., AhadM.A.R., TanJ.K., KimH.S. and IshikawaS., A robust face tracking method by employing color-based particle filter, Biomedical Fuzzy and Human Sciences: The Official Journal of the Biomedical Fuzzy Systems Association16 (2011), 127-134.
13.
MarkusN., Overview of algorithms for face detection and tracking, retrieved from https://www.fer.unizg.hr/_download/ repository/KDI_Nenad_Markus.pdf, (accessed at 22-Jan-16).
14.
LucasB.D. and KanadeT., An iterative image registration technique with an application to stereo vision, IJCAI (1981), 674-679.
15.
TomasiC. and KanadeT., Detection and tracking of point features, Carnegie Mellon University Technical Report CMU-CS-91-132, April 1991.
16.
ShiJ. and TomasiC., Good features to track, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Jun 1994), 593-600.
17.
Ben-IsraelA., A Newton-Raphson method for the solution of systems of equations, Journal of Mathematical Analysis and Applications15.2 (1966), 243-252.
18.
MattaF. and DugelayJ.L., Person recognition using facial video information: A state of the art, Journal of Visual Languages and Computing20 (2009), 180-187.
19.
ChellappaR., DuM., TuragaP. and ZhouS.K., Face tracking and recognition in video, Springer-Verlag London Limited, Princeton, 2011, pp. 323-351.
20.
TurkM.A. and PentlandA.P., Face recognition using eigenfaces, Proc IEEE (1991), 586-591.
21.
BelhumeurP., HespanhaJ. and KriegmanD., Eigenfaces vs. fisherfaces: Recognition using class specific linear projection, IEEE Transactions on Pattern Analysis and Machine Intelligence19(7) (1997), 711-720.
22.
BartlettM.S., MovellanJ.R. and SejnowskiT.J., Face recognition by independent component analysis, IEEE Trans Neural Network13(6) (2002), 1450-1464.
23.
SharkasM. and ElenienM.A., Eigenfaces vs. Fisherfaces vs. ica for face recognition: A comparative study, in: 9th International Conference on Signal Processing (ICSP), Beijing, China, (2008), 914-919.
24.
SirovichL. and KirbyM., A low-dimensional procedure for the characterization of human faces, J Optical Soc Am A4(3) (1987), 519-524.
25.
JebaraT., 3D pose estimation and normalization for face recognition, Center for Intelligent Machines, McGill University, undergraduate Thesis May 1996.
26.
CoxI.J., GhosnJ. and YianilosP.N., Feature based face recognition using mixture distance, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (1996), 209-216.
27.
BrunelliR. and PoggioT., Face recognition through geometrical features, in: Proceedings of the Second European Conference on Computer Vision, SandiniG., ed., Vol. 588, Lecture Notes In Computer Science, London, UK: Springer-Verlag, 1992, pp. 782-800.
28.
CendrillonR. and LowellB.C., Real-time face recognition using eigenfaces, in: Proceedings of the SPIE International Conference on Visual Communications and Image Processing4067 (2000), 269-276.
29.
ZhangC. and ZhangZ., Boosting-based face detection and adaptation, Sams Python, Chapter 1, 2010, pp. 1-8.
30.
LienhartR. and MaydtJ., An extended set of haar-like features for rapid object detection, in: International Conference on Image Processing (ICIP), Rochester, 2002.
31.
ZhangC. and ZhangZ., A survey of recent advances in face detection, Microsoft Research, Redmond, 2010.
32.
SwetsD. and WengJ., Using discriminant eigenfeatures for image retrieval, IEEE Transactions on Pattern Analysis and Machine Intelligence18(8) (1996), 831-836.
33.
MartinezA. and KakA., PCA versus LDA, IEEE Transactions on Pattern Analysis and Machine Intelligence23(2) (2001), 228-233.
34.
JafriR. and ArabniaH.R., A survey of face recognition techniques, Journal of Information Processing Systems5(2) (2009), 41-68.
35.
ChellappaR., WilsonC.L. and SiroheyS., Human and machine recognition of faces: A survey, Proceedings of the IEEE83 (1995), 705-740.
36.
MoodyJ. and DarkenC., Learning with localized receptive fields, in: Proceedings of the 1988 Connectionist Models Summer School, TouretzkyD., HintonG. and SejnowskiT., eds, Morgan Kaufmann, 1988, pp. 133-143.
37.
MoodyJ. and DarkenC., Fast learning in networks of locally-tuned processing units, Neural Computation1 (1989), 281-294.
38.
HowellA. and BuxtonH., Towards unconstrained face recognition from image sequences, in: Proceedings of the Second IEEE International Conference on Automatic Face and Gesture Recognition, (1996), 224-229.
39.
McKennaS. and GongS., Combined motion and model-based face tracking, in: Proceedings of British Machine Vision Conference, Edinburgh, UK, (1996), 755-765.
40.
FerisR.S., CamposT.E. and CesarR.M., Jr, Detection and tracking of facial features in video sequences, in: Mexican International Conference on Artificial Intelligence (MICAI 2000), Lecture Notes in Artificial Intelligence, Acapulco, Mexico: Springer-Verlag 1793 (2000), 129-137.
41.
de CamposT.E., FerisR.S. and CesarR.M., Jr, A framework for face recognition from video sequences using GWN and eigenfeature selection, in: Workshop on Artificial Intelligence and Computer Vision, Atibaia, Brazil, (2000).
42.
KrugerV. and SommerG., Affine real-time face tracking using a wavelet network, in: ICCV'99 Workshop: Recognition, Analysis, and Tracking of Faces and Gestures in R Real-Time Systems, Corfu, Greece, (1999), 141-148.
43.
PentlandA., MoghaddamB. and StarnerT., View-based and modular eigenspaces for face recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, (1994), 84-90.
44.
de CamposT.E., BlochI. and CesarR.M., Jr, Feature selection based on fuzzy distances between clusters: First results on simulated data, in: Proceedings of International Conference on Advances on Pattern Recognition-ICAPR'2000, Lecture Notes In Computer Science. Rio de Janeiro, Brasil: Springer-Verlag 2013 (2001), 186-195.
45.
DudaR. and HartP., Pattern classification and scene analysis, New York, USA: Wiley, 1973.
46.
JainA.K., DuinR.P.W. and MaoJ., Statistical pattern recognition: A review, IEEE Transactions on Pattern Analysis and Machine Intelligence22 (2000), 4-37.
47.
KrügerV. and ZhouS., Exemplar-based face recognition from video, in: Computer Vision - ECCV 2002: 7th European Conference on Computer Vision Copenhagen, Denmark, May 28-31, 2002 Proceedings, Part IV, HeydenA., SparrG., NielsenM. and JohansenP., eds, ed Berlin, Heidelberg: Springer Berlin Heidelberg, 2002, pp. 732-746.
48.
ZhouS., KruegerV. and ChellappaR., Face recognition from video: A condensation approach, in: Proc of Fifth IEEE International Conference on Automatic Face and Gesture Recognition, Washington D.C., USA, (2002), 221-228.
49.
MarcialisG.L. and RoliF., Fusion of face recognition algorithms for video-based surveillance systems, in: Multisensor Surveillance Systems: The Fusion Perspective, ForestiG.L., RegazzoniC.S. and VarshneyP.K., eds, Kluwer, 2003, pp. 235-250.
50.
SteffensJ., ElaginE. and NevenH., Person Spotter fast and robust system for human detection, tracking and recognition, in: Proceedings, International Conference on Audio- and Video-Based Person Authentication (1999), 96-101.
51.
ChoudhryT., ClarksonB., JebaraT. and PentlandA., Multimodal person recognition using unconstrained audio and video, in: Proceedings, International Conference on Audio and Video-based Person Authentication (1999), 176-181.
52.
De-la-TorreM., GrangerE., SabourinR. and GorodnichyD.O., Adaptive skew-sensitive ensembles for face recognition in video surveillance, Pattern Recognition48(11) (2015), 3385-3406.
53.
RaducanuB., BosaghzadehA. and DornaikaF., Multi-observation face recognition in videos based on label propagation, in: Computer Vision and Pattern Recognition Workshops (CVPRW), 2015 IEEE Conference on (7-12 June 2015), 10-17.
54.
KhanN.M., NanX., QuddusA., RosalesE. and GuanL., On video based face recognition through adaptive sparse dictionary, in: Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on1 (4-8 May 2015), 1-6.
55.
HassanpourN. and ChenL., A hierarchical training and identification method using Gaussian process models for face recognition in videos, in: Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on1 (4-8 May 2015), 1-8.
56.
HuangZ., WangR., ShanS. and ChenX., Face recognition on large-scale video in the wild with hybrid euclidean-and-riemannian metric learning, Pattern Recognition (PR)48(10) (2015), 3113-3124.
57.
RagasheM.U., GoswamiM.M. and RaghuwanshM.M., A face recognition technique for partial occluded faces in streaming video, International Journal of Applied Engineering Research10(20) (2015), 17860-17865.
58.
ChenZ., WuH.B. and XiaS.P., A cooperative dual-camera system for face recognition and video monitoring, Advanced Materials Research998-999 (Jul 2014), 784-788.
59.
AnL., BhanuB. and YangS., Face recognition in multi-camera surveillance videos, in: Pattern Recognition (ICPR), 2012 21st International Conference on (11-15 Nov 2012), 2885-2888.
60.
ArandjelovićO., Colour invariants under a non-linear photometric camera model and their application to face recognition from video, Pattern Recognition45(7) (July 2012), 2499-2509.
61.
AnL., KafaiM. and BhanuB., Face recognition in multi-camera surveillance videos using dynamic Bayesian network, in: Distributed Smart Cameras (ICDSC), 2012 Sixth International Conference on (30 Oct 2012-2 Nov 2012), 1-6.
62.
DamavandinejadmonfaredS., Kernel entropy component analysis using local mean-based k-nearest centroid neighbour (LMKNCN) as a classifier for face recognition in video surveillance camera systems, in: Intelligent Computer Communication and Processing (ICCP), 2012 IEEE International Conference on (30 Aug 2012-1 Sept 2012), 253-256.
63.
FassoldH., SchallaueP., RosnerJ. and BailerW., Real time KLT feature point tracking for high definition video, GraVisMa, 2009.
64.
FreundY. and SchapireR.E., A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences55(1) (Aug 1997), 119-139.
65.
FerisR., TianY. and HampapurA., Capturing people in surveillance video, Procedure IEEE Int Workshop Visual Surveillance (2007), 1-8.
66.
HjelmasE. and LowB.K., Face detection: A survey, Computer Vision and Image Understanding81 (2001), 236-274.
67.
AbramsonY., SteuxB. and GhorayebH., YEF real-time object detection, in: International Workshop on Automatic Learning and Real-Time (ALaRT), Siegen, (2005).
68.
DashoreG. and RajV.C., Efficient method for face recognition using principal component analysis (PCA), International Journal of Advanced Technology & Engineering Research, (2012).
