Semantic Understanding in Digital Video and Audio

07/21/1998


Click here to start


Table of Contents

Semantic Understanding in Digital Video and Audio

Informedia Digital Video Library Project

Informedia Digital Video Library

Informedia Library Creation

Informedia Library Exploration

Techniques Underlying Abstractions

Automatic Video Characterization

Camera and Motion Detection

Text Extraction

Video OCR

Face Detection Results

Image Search & Similarity Matching

Image Similarity Challenge

Images Containing Similar Colors

Images Containing Similar Shapes

Images Containing Similar Content

Image Understanding Results

Text Extraction and Alignment

Speech Recognition Accuracy

Speech Recognizer Results

Hints for Speech Recognition

“Name-It” Face/Name Association

Deriving “Matching Shots”

Text Title Abstraction

Empirical Study Concerning “Poster Frames” (Thumbnail Images)

Text-based Result List

“Naïve” Poster Frame Result List (Uses First Shot Image)

Query-based Poster Frame Result List

Query-based Poster Frame Selection Process

Poster Frame Study Results

Empirical Study Summary*

Text Title Abstraction Revisited

Filmstrip Abstraction

Filmstrips: Further Work

“Skim Video”: Extraction of Significant Content

Skims: Preliminary Findings

Empirical Study: Skims

Skim Study Results

Skim Study QUIS Results

More Subjective Scale Results

Skim Study Results

Match Information

Enhancing Match Information

Discussed Multimedia Abstractions

Range of Multimedia Abstractions

Informedia Focus

Evaluating Multimedia Abstractions

Future Directions

Credits

Author: Mike Christel

Email: christel@cs.cmu.edu

Home Page: http://www.cs.cmu.edu/~christel