An End-to-End Structured Method for News Programs
A structured and news technology, applied in speech analysis, instrument, character and pattern recognition, etc., can solve the problem of unsatisfied real-time performance of the secondary editing of news programs, and improve the timeliness of use, reduce errors, and improve accuracy. rate effect
Active Publication Date: 2019-09-20
CHENGDU SOBEY DIGITAL TECH CO LTD
View PDF11 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The purpose of the present invention is: in order to solve the problem of unsatisfied real-time performance of news program access and secondary editing by using the original manual method to segment and label the ever-increasing massive news streams, the present invention provides a terminal The end-to-end news program structuring method and its structural framework system integrate cross-modal information such as news grammar, visual features, audio features, and text semantics, and integrate various artificial intelligence technologies such as computer vision, machine learning, and natural language processing. , realized the segmentation of Scene level and Story level structure of news programs and automatic description of core metadata at one time
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0030] Such as figure 1 and figure 2 As shown, this embodiment provides an end-to-end news program structuring method, including the following steps:
[0031] S1: Preprocessing the input news program, respectively obtaining audio resources and video resources of the news program;
[0032] S2: Use ASR speech recognition technology, OCR text recognition technology and lens detection technology to extract basic information in audio resources and video resources;
[0033] Performing basic information analysis on audio resources in said S2 includes:
[0034] Based on the audio judgment analysis technology of MFCCs audio characteristics, the sound information of audio resources can be identified, and the pause interval of speech broadcast can be judged through audio feature analysis. The audio pause interval time points will be used for subsequent scene detection;
[0035] The voice content of audio resources is converted into text content through ASR speech recognition technolo...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more PUM
Login to view more Abstract
The invention discloses an end-to-end news program structuring method and its structuring framework system, and relates to the technical field of news program processing. The method of the invention includes preprocessing the input news program, and obtaining the audio resource and video of the news program resources; use ASR speech recognition technology, OCR text recognition technology and Shot Detection technology to extract basic information in audio resources and video resources; based on the extracted basic information, extract semantic theme information of each modality, and adopt cross-modal theme fusion Extraction algorithm, fusion and clustering of semantic theme information of each modality, and output Scene theme; at the same time, cross-modal scene detection, output Scene level; use CRF scene labeling algorithm to perform scene aggregation and segmentation on the obtained Scene level and Scene theme , and output Story levels and Story topics with the same semantics. The present invention focuses on Story layers and Scene layers with clear semantic meanings, which facilitates the secondary utilization of news programs and improves the timeliness of news programs.
Description
technical field [0001] The present invention relates to the technical field of news program processing, and more specifically relates to an end-to-end news program structuring method and its structuring framework system. Background technique [0002] With the development of the times and the advancement of technology, video indexing and retrieval is an important issue and has great significance. And TV news is a large part of the video, and it is also a video that will be used repeatedly. For example, for on-demand broadcasting of TV news, it is necessary to segment the TV news stream, and then mark each segment of TV news stream with metadata, so as to quickly index and access; TV news programs are used as a material again, and used as The editorial materials of other news programs often reuse valuable fragments of news, and it is also necessary to decompose the TV news stream according to the structure of TV news and mark the valuable fragments. [0003] News video is an...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more Application Information
Patent Timeline
Login to view more Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/439H04N21/44H04N21/472G06K9/20G06K9/34G10L15/26
CPCH04N21/4394H04N21/44008H04N21/47205G10L15/26G06V10/225G06V30/153
Inventor 王炜温序铭谢超平李杰严照宇孙翔罗明利
Owner CHENGDU SOBEY DIGITAL TECH CO LTD
Who we serve
- R&D Engineer
- R&D Manager
- IP Professional
Why Eureka
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Social media
Try Eureka
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap