Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video score recommendation method, device and equipment based on neural network technology

A technology of neural network and recommendation method, which is applied in the direction of neural learning method, biological neural network model, special data processing application, etc. It can solve the problems of unsatisfactory fusion situation, low matching degree of soundtrack and video, etc., achieve good fusion ability and improve The effect of matching quality

Active Publication Date: 2021-08-20
PING AN TECH (SHENZHEN) CO LTD
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The fusion of features of different modalities in the artificial neural network model determines the matching of the final recommended soundtrack and video to a certain extent. However, the fusion of features of different modalities in the existing artificial neural network models is mostly not Not ideal, resulting in a poor match between the final recommended soundtrack and the video
It can be seen that the matching quality of the soundtrack and video recommended by the current video soundtrack recommendation method based on neural network technology still has room for improvement.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video score recommendation method, device and equipment based on neural network technology
  • Video score recommendation method, device and equipment based on neural network technology
  • Video score recommendation method, device and equipment based on neural network technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] see figure 1 , figure 1 It is a schematic flowchart of a method for recommending video soundtrack based on neural network technology disclosed in an embodiment of the present invention. Such as figure 1 As shown, the video soundtrack recommendation method based on neural network technology may include the following operations:

[0031] 101. Input the video collection containing multiple pieces of music to be selected and the music library containing multiple pieces of music to be selected into the pre-trained style label prediction model for analysis, and obtain the video style label information corresponding to the video collection and the information of each piece. Describe the audio style tag information corresponding to the soundtrack to be selected;

[0032] In the above step 101, the output of the style tag prediction model may include video style tag information, audio style tag information, and a tag similarity value representing the similarity between the vi...

Embodiment 2

[0085] see image 3 , image 3 It is a structural schematic diagram of a device for recommending video soundtrack based on neural network technology disclosed in an embodiment of the present invention. Such as image 3 As shown, the video soundtrack recommendation device based on neural network technology may include:

[0086] The analysis module 301 is used to input the video collection containing multiple pieces of music to be selected and the music library containing multiple pieces of music to be selected into the pre-trained style label prediction model for analysis, and obtain the video style label information corresponding to the video collection Audio style tag information corresponding to each piece of the soundtrack to be selected, wherein the output of the style tag prediction model includes video style tag information, audio style tag information, and information used to represent the video style tag information and the audio style The tag similarity value of th...

Embodiment 3

[0091] see Figure 4 , Figure 4 It is a schematic structural diagram of a computer device disclosed in an embodiment of the present invention. Such as Figure 4 As shown, the computer equipment may include:

[0092] A memory 401 storing executable program codes;

[0093] A processor 402 connected to the memory 401;

[0094]The processor 402 invokes the executable program code stored in the memory 401 to execute the steps in the method for recommending video soundtrack based on neural network technology disclosed in Embodiment 1 of the present invention.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video incidental music recommendation method based on a neural network technology, and the method comprises the steps: inputting a video set containing a plurality of to-be-incidental music videos and a music library containing a plurality of to-be-selected incidental music videos into a pre-trained style label prediction model for analysis, obtaining video style label information corresponding to the video set and audio style label information corresponding to each segment of to-be-selected music; according to the video style label information corresponding to the video set and the audio style label information corresponding to each segment of the to-be-selected incidental music, calculating a matching value between the video set and each segment of the to-be-selected incidental music; and according to the video set and the matching value of each segment of the to-be-selected score, screening out a target score from the music library to serve as the score of the video set. Therefore, the method can enable the pre-trained style label prediction model to have a better fusion capability for the characteristics of two different modes, namely audio and video, so that the matching quality of the finally recommended dubby music and video can be improved. The invention also relates to the technical field of blockchains.

Description

technical field [0001] The present invention relates to the technical field of neural network, in particular to a method, device, computer equipment and storage medium for recommending video soundtrack based on neural network technology. Background technique [0002] Automatic video soundtracking is a common video processing technology, which can automatically select the appropriate soundtrack for the video, and then use the selected soundtrack to complete the soundtrack processing of the video, which can save a lot of video creators. The time for the soundtrack enables video creators to focus on the content of the video, which provides great convenience for video creators to create videos. [0003] The key point of the automatic video soundtrack technology is the automatic recommendation of the soundtrack (that is, to filter out the soundtrack that matches the video from the music library). At present, it is a common practice to use an artificial neural network model to au...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/735G06F16/783G06N3/02G06N3/08
CPCG06F16/7834G06F16/735G06N3/02G06N3/08
Inventor 罗剑王健宗程宁
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com