Sketch data reuse and scene sketch auxiliary construction method and system

A sketch and scene technology, applied in the field of computer vision, can solve problems such as difficulty in sketching and low reuse rate of sketch data

Active Publication Date: 2022-08-02
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF15 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to overcome the existing sketch interaction-based methods and applications that have a low reuse rate of sketch data and difficulty in inputting sketches by users, the present invention proposes a sketch data reuse and scene sketch auxiliary construction method and system, which utilizes the efficient information of sketch interaction Based on the advantages of representation, based on intelligent sketch processing technologies such as sketch repair and sketch-based image retrieval, the existing sketch materials are extracted and reused; the extracted sketch materials and the sketch data stored in the database are used to assist users in the construction of scene sketches, thereby For subsequent applications such as sketch retrieval and video positioning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sketch data reuse and scene sketch auxiliary construction method and system
  • Sketch data reuse and scene sketch auxiliary construction method and system
  • Sketch data reuse and scene sketch auxiliary construction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] This embodiment proposes a system and method for reusing sketch data and auxiliary construction of scene sketches, which are proposed for the problem of reusing sketch data and auxiliary construction of scene sketches, such as the extraction of common sketch materials, the reuse of sketch data, and the interaction of sketches in image retrieval and video. Positioning technical solutions.

[0039] A sketch data reuse and scene sketch assistant construction system proposed in this embodiment includes a top-level interactive interface and a bottom-level data processing module. The interactive interface is as follows: figure 1 (the pictures of cows, people, grass, etc. displayed on the interface in the figure belong to an example in this embodiment), which includes: a sketch data extraction page, a scene sketch construction and image retrieval page, and a scene sketch-based video positioning page. The operation can be switched between the three pages via the page switch but...

Embodiment 2

[0047] This embodiment provides a specific application example of a system and method for providing a sketch data reuse and scene sketch assistant construction, such as figure 2 As shown, the method includes the following steps:

[0048] S1: When the user browses the scene sketch, the user selects the sketch object of interest, and the system repairs the sketch and saves it to the user's personal favorites (see figure 2 (1)), occasionally when the algorithm does not work well, the system provides a sketching tool to support the user to manually extract objects in the scene sketch.

[0049] S2: The user uses sketch materials in personal favorites or public databases to construct scene sketches (see figure 2 (2)), the user can also search for images using the created scene sketch (see figure 2 (3)).

[0050] S3: The system allows the user to reselect the sketch material, adjust the objects in the scene sketch to optimize the current scene sketch (see figure 2 (4)) to re...

Embodiment 3

[0052] This embodiment proposes a system and method for reusing sketch data and assisting construction of scene sketches, which perform video positioning based on sketches, and use a video positioning page based on scene sketches, such as image 3 As shown, this page includes: ① scene sketch construction canvas; ② scene sketch editing tool panel; ③ sketch material browsing and selection panel; ④ sketch sequence display panel; ⑤ video positioning result display panel. Where ①②③ are the same as in Embodiment 1, ④ the sketch sequence display panel is used to display the sketch sequence, and ⑤ the video positioning result display panel is used to display the positioned video clips. Video targeting consists of three steps:

[0053] S1: Scene sketch construction. Users build scene sketches based on target clips positioned in the video, and this system allows users to reuse existing sketch materials to speed up the construction process by dragging, moving, zooming, and rotating.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sketch data reuse and scene sketch auxiliary construction method and system, belongs to the field of computer vision, and aims to extract and reuse existing sketch materials by utilizing the advantage of efficient information representation of sketch interaction and sketch intelligent processing technologies such as sketch restoration and sketch-based image retrieval; the extracted sketch materials and sketch data stored in a database are used for assisting a user in scene sketch construction, and therefore the scene sketch construction method is used for follow-up applications such as sketch retrieval and video positioning.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a method and system for reusing sketch data and auxiliary construction of scene sketches. Background technique [0002] Visual media application based on sketch interaction has always been a research hotspot in the fields of human-computer interaction, computer vision and multimedia. How to optimize the basic processing of sketch data and improve the efficiency of sketch-based visual media application is the key issue of research. Sketch interaction is widely used in various aspects of life and work, including painting, note-taking, document annotation, web user interface (UI) and concept design in the Internet industry, animation and film and television production in the film animation industry, etc. In recent years, research and applications related to sketch interaction have attracted widespread attention in both industry and academia. One of the important reasons is...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/0481G06F16/53G06T11/00
CPCG06F3/0481G06F16/53G06T11/00Y02D10/00
Inventor 马翠霞刘舫宋建成邓小明王宏安
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products