• 讲座信息

Constructing Knowledge Representation from Lecture Videos through Multimodal Analysis

2013.02.28

讲座人:Ting-Chuen Pong (Professor of Computer Science and Engineering,Hong Kong University of Science and Technology)讲座时间:2013.3.5 上午 9:30-10:30讲座地点:复旦大学张江校区计算机楼 305联系人:姜育刚 ygj@fudan.edu.cnAbstract:E-learning has presented new opportunities for learning with the rapid development of information and communication technologies (ICTs). Lecture video is one of the most commonly used learning materials on e-learning platforms. It presents knowledge in a lively manner and keeps the learners more attentive during the learning process. While organizing lecture videos in a sequential list seems to be a natural choice, it presents the problems of inefficiency in searching for domain concepts and the inability to show relationships between such concepts. In this work, the task of constructing a knowledge representation scheme for video corpuses is explored. The knowledge representation aims to achieve the goals of facilitating the searching of domain concepts and to extract the relationships between the concepts so as to identify effective learning strategies for the corpus. A framework using text recognition, speech recognition, multimodal analysis and clustering techniques is proposed for the construction of the knowledge representation. Experimental results have shown that the framework can be used to achieve the intended goals under specific assumptions.Bio:Ting-Chuen Pong received his PhD in Computer Science from Virginia Polytechnic Institute and State University, USA in 1984. He joined the University of Minnesota - Minneapolis, USA as an Assistant Professor of Computer Science in 1984 and was promoted to Associate Professor in 1990. In 1991, he joined the Hong Kong University of Science & Technology (HKUST) as a founding faculty member, where he is currently a Professor of Computer Science and Engineering. He was an Associate Vice-President for Academic Affairs at HKUST from 2002 to 2010, an Associate Dean of Engineering from 1999 to 2002, Director of the Sino Software Research Institute from 1995 to 2000 and Head of the W3C Office in Hong Kong from 2000 to 2003. He also served as an Academic Research Adviser for the Hong Kong Research Grants Council (RGC) from 2010 to 2012. Professor Pong is a recipient of the HKUST Excellence in Teaching Innovation Award in 2001.Professor Pong's research interests include computer vision, image processing, multimedia computer, and IT in Education. He is a recipient of the Annual Pattern Recognition Society Award in 1990 and Honorable Mention Award in 1986. He has served as Program Co-Chair of the Web and Education Track of the Tenth International World Wide Web Conference in 2001, the Third Asian Conference on Computer Vision in 1998, and the Third International Computer Science Conference in 1995. He is a registered auditor of the Quality Assurance Council of the University Grants Committee of Hong Kong since 2008.