A novel framework for semantic annotation of soccer sports video sequences (original) (raw)

Manual annotation is both impractical and very expensive, due to the vast amount of data generated at a rapid rate A novel framework is presented for semantic labeling of by such videos. However, automatic annotation is a very video clips, automatically segmented from broadcast video demanding and an extremely challenging computer vision task of soccer (football) games, as highlights and excitement as it involves high-level scene interpretation. In , authors clips etc. The proposed framework provides a generalizable presented a web-casting text based annotation scheme. In method for linking low-level video features with high- [1], authors proposed Finite State Machine based annotation level semantic concepts defined in a commonly understood of soccer video. Barnard et. al. proposed [3] HMM based sports lexicon. Three important contributions are made to framework to fuse audio and video features to recognize the automatic annotation of sports video, as follows. First, domain play and break scenes in soccer video sequences. Li et. al. knowledge combined with an event-lexicon and a four-level proposed rule based algorithm using low-level audio/video hierarchical classifier based on low-level video features is features for football video summarization. Babaguchi et. used to label video segments. Second, a priori event mining al. proposed event detection by recognizing the textual is used to establish probabilistic event-associations that are overlays from football video. used to assign a concept-lexicon, such as goals and saves, to There have been many successful works in soccer video each highlight video segment. And, finally, the collection of analysis as mentioned above. But most of these works fail to highlight video clips is summarized using concept-and eventrespond to action-based queries, such as "extract the goal clips lexicons to facilitate highlight browsing, video skimming, out of this soccer sequence", or "extract the saves from this indexing and retrieval. soccer video", "extract goals scored by team-A", "extract all the red card events from the collection of FIFA 2006 world 1 Introduction cup matches", etc. At higher level, user may ask the specific queries such as, "extract the replay segment from the goal clip