In this paper, we propose automatic categorization and summarization of documentaries using subtitles of videos. We propose two methods for video categorization. The first makes unsupervised categorization by applying natural language processing techniques on video subtitles and uses the WordNet lexical database and WordNet domains. The second has the same extraction steps but uses a learning module to categorize. Experiments with documentary videos give promising results in discovering the correct categories of videos. We also propose a video summarization method using the subtitles of videos and text summarization techniques. Significant sentences in the subtitles of a video are identified using these techniques and a video summary is then composed by finding the video parts corresponding to these summary sentences.
D. Brezeale , D.J. Cook, Automatic video classification: a survey of the literature, IEEE Transactions Systems, Man and Cybernetics Part C: Applications and Reviews38(3) (2008) 416-430.
2.
S. Teufel and M. Moens, Sentence extraction as a classification task, Proceedings of ACL/EACL 97 WS (Madrid, Spain, 1997).
3.
X. Yuan, W. Lai, T. Mei, X.S. Hua, X.Q. Wu and S. Li, Automatic video genre categorization using hierarchical SVM, Proceedings of IEEE International Conference on Image Processing (2006) 2905-2908.
4.
W. Zhu , C. Toklu and S.P. Liou, Automatic news video segmentation and categorization based on closed-captioned text, ISIS Technical Report Series 20 (2001).
5.
F.N. Bezerra and E. Lima, Low cost soccer video summaries based on visual rhythm, Proceedings of the 14th Annual ACM International Conference on Multimedia (Santa Barbara, CA, 23-27 October 2006) 71-77.
6.
P. Katsiouli , V. Tsetsos and S. Hadjiefthymiades, Semantic video classification based on subtitles domain terminologies, Proceedings of SAMT Workshop on Knowledge Acquisition from Multimedia Content (KAMC) (Genoa, Italy, 2007).
7.
C. DeMenthon , V. Kobla and D. Doermann, Video summarization by curve simplification , Proceedings of ACM Multimedia ( 1998) 211-218.
8.
B. Barbieri, N. Dimitrova and L. Agnihotri, Movie-in-a-minute: automatically generated video previews, Proceedings of IEEE Pacific Rim Conference on Multimedia (9-18 February 2004).
9.
K. Fujimura, K. Honda and K. Uehara, Automatic video summarization by using color and utterance information, Proceedings of IEEE ICME (2002) 49-52.
10.
R. Mihalcea and P. Tarau, TextRank - bringing order into texts, Proceedings of the Conference on Empirical Methods in Natural Language Processing ( Barcelona, Spain, 2004).
11.
G. Ercan and I. Cicekli, Lexical cohesion based topic modeling for summarization, Proceedings of the CICLing ( 2008) 582-592.
12.
P. Wang, R. Cai and S.Q. Yang, A hybrid approach to news video classification multimodal features, Proceedings of the Joint Conference of the Fourth International Conference on Information, Communications and Signal Processing and the Fourth Pacific Rim Conference on Multimedia (2003) 787-791.
13.
W. Qi, L. Gu, H. Jiang, X.R. Chen and H.J. Zhang, Integrating visual, audio and text analysis for news video, Proceedings of 7th IEEE International Conference Image Processing (2000) 520-523.
14.
N. Benjamas, N. Cooharojananone and C. Jaruskulchai, Flashlight and player detection in fighting sport for video summarization , Proceedings of the IEEE International Symposium on Communications and Information Technology (Beijing, China, 12-14 October 2005) 441-444.
15.
A. Money and H. Agius, Video summarisation: a conceptual framework and survey of the state of the art, Journal of Visual Communication and Image Representation19(2) ( 2008) 121-143.
16.
A. Ekin, M. Tekalp and R. Mehrotra, Automatic soccer video analysis and summarization, IEEE Transactions on Image Processing 12(7) (2003) 796-807.
17.
G. Ciocca and R. Schettini, Dynamic storyboards for video content summarization, Proceedings of the 8th ACM SIGMM International Workshop on Multimedia Information Retrieval (Santa Barbara, CA, 26-27 October 2006).
18.
Z. Cernekova , I. Pitas and C. Nikou, Information theory-based shot cut/fade detection and video summarization, IEEE Transactions on Circuits and Systems for Video Technology16(1) (2006) 82-91.
19.
A. Girgensohn , A fast layout algorithm for visual video summaries , Proceedings of the IEEE International Conference on Multimedia and Expo (Baltimore, MD, 6-9 July 2003) 77-80.
20.
B. Ngo , Y. Ma and H. Zhang, Video summarization and scene detection by graph modeling, IEEE Transactions on Circuits and Systems for Video Technology15(2) (2005) 296-305.
21.
Y. Rui, A. Gupta and A. Acero, Automatically extracting highlights for TV baseball programs, Proceedings of the 8th ACM International Conference on Multimedia (Los Angeles, CA, 30 October 2000) 105-115.
22.
M. Pickering , L. Wong and S. Ruger, ANSES: summarisation of News Video, Proceedings of CIVR-2003 (University of Illinois, IL, 24-25 July 2003).
23.
T. Tsoneva, M. Barbieri and H. Weda, Automated summarization of narrative video on a semantic level, Proceedings of the International Conference on Semantic Computing (17-19 September 2007) 169-176.
24.
F.N. Bezerra and E. Lima, Low cost soccer video summaries based on visual rhythm, Proceedings of the 14th Annual ACM International Conference on Multimedia (Santa Barbara, CA, 23-27 October 2006) 71-77.
25.
J. Kupiec, J.O. Pedersen and F. Chen, A trainable document summarizer, Proceedings of SIGIR 1995 (ACM Press, New York , 1995) 68-73.
26.
D.R. Radev, H. Jing and M. Budzikowska, Centroid-based summarization of multiple documents: sentence extraction, utility-based evaluation, and user studies, Proceedings of ANLP/NAACL00-WS , (Seattle, WA, 2000).
27.
G. Erkan and D.R. Radev, Lexrank: graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research22 (2004) 457-479.
28.
L. Page, S. Brin, R. Motwani and T. Winograd, The pagerank citation ranking: bringing order to the web, Technical Report , Stanford Digital Library Technologies Project, 1998.
29.
R. Barzilay and M. Elhadad, Using lexical chains for text summarization. In: I. Mani and M.T. Maybury (eds), Advances in Automatic Text Summarization (The MIT Press , Cambridge, MA, 1999) 111-121.
30.
M. Brunn, Y. Chali and C.J. Pinchak, Text summarization using lexical chains, Proceedings of the Document Understanding Conference (DUC01) (New Orleans, LA, 2001).
31.
W.P. Doran, N. Stokes, J. Carthy and J. Dunnion, Assessing the impact of lexical chain scoring methods and sentence extraction schemes on summarization, Proceedings of CICLing (2004) 627-635.
32.
G.H. Silber and K. McCoy, Efficient text summarization using lexical chains, Proceedings of the ACM Conference on Intelligent User Interfaces (IUI’2000) , 9-12 January 2000.
33.
Y. Chali and M. Kolla, University of Lethridge summarizer at DUC04, Proceedings of DUC04 ( Boston, July 2004).
34.
L. Bentivogli , P. Forner, B. Magnini and E. Pianta, Revising WordNet Domains hierarchy: semantics, coverage, and balancing, Proceedings of COLING Workshop on Multilingual Linguistic Resources (Geneva, 2004) 101-108.
35.
S. Banerjee and T. Pedersen, An adapted Lesk algorithm for word sense disambiguation using WordNet, Proceedings of the 3rd International Conference on Intelligent Text Processing and Computational Linguistics (CICLING-02) ( Mexico City, 2002).
36.
Stanford Log-linear Part-Of-Speech Tagger, Available at: http://nlp.stanford.edu/software/tagger.shtml
37.
Penn Treebank, Available at: www.cis.upenn.edu/~treebank/
38.
M. Hepple, Independence and commitment: assumptions for rapid training and execution of rule-based part-of-speech taggers, Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (Hong Kong, 2000).
39.
M. Galley and K. McKeown, Improving word sense disambiguation in lexical chaining, Proceedings of the 18th International Joint Conference on Artificial Intelligence (2003) 1486-1488.
40.
C.Y. Lin and E.H. Hovy, Automatic evaluation of summaries using n-gram co-occurrence statistics, Proceedings of HLT-NAACL-2003 (Edmenton, Canada, 2003 ).
