Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Data processing method, electronic device and system based on gpu resources

A data processing and resource technology, applied in the computer field, can solve the problems of mutual interference, unable to support migration, unable to schedule computing tasks, etc., to achieve the effect of flexible scheduling, high flexibility and portability

Active Publication Date: 2021-02-19
ADVANCED NEW TECH CO LTD
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the isolation of AI learning applications cannot be achieved, and there are resource preemption and mutual interference between different AI learning applications
And cannot schedule computing tasks to different nodes, therefore, cannot support migration, resulting in inflexible scheduling
For example, the solution based on remote system calls: at the time of dynamic running, the GPU resource request is intercepted, and then forwarded to the target to obtain the bound GPU resource. Since the resource has been bound, it cannot support hot migration (that is, it cannot be dynamically and timely Migrate the application between different physical GPUs on the same machine or between physical GPUs on different machines), which leads to inflexible scheduling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, electronic device and system based on gpu resources
  • Data processing method, electronic device and system based on gpu resources
  • Data processing method, electronic device and system based on gpu resources

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the purpose, technical solutions and advantages of the embodiments of this specification more clear, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments It is a part of the embodiments of this specification, but not all of them. Based on the embodiments in the embodiments of this specification, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the embodiments of this specification.

[0021] The GPU resource-based data processing method provided in the embodiment of this specification can be applied to the following scenario: there are multiple application programs that need to use GPU resources on the same network node to complete their respective computing tasks. There is a resource policy for the physi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The GPU resource-based data processing method, electronic device, and system disclosed in this specification create N virtual GPU resources according to the resource allocation policy and physical GPU resources; and generate resource mapping between physical GPU resources and virtual GPU resources according to the resource allocation policy. relationship; each resource application module obtains a target virtual GPU resource among the N virtual GPU resources according to the resource mapping relationship.

Description

technical field [0001] The embodiments of this specification relate to the field of computers, and in particular to a GPU resource-based data processing method, electronic device, and system. Background technique [0002] AI (Artificial Intelligence, artificial intelligence), especially DL (Deep Learning, deep learning) has been widely used in payment (face), loss assessment (picture recognition), interaction and customer service (speech recognition, text content extraction and filtering), etc. This scenario has achieved remarkable results. Typical DL tasks require powerful computing support, so most of the current tasks run on acceleration devices such as GPU (Graphics Processing Unit, Graphics Processing Unit). GPU is a high-performance computing acceleration device that is currently widely used in AI, For deep learning training and online services, the hardware of the physical GPU is driven by the GPU driver to realize the training of AI tasks, online services, etc. [...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50G06F9/455
CPCG06F9/45558G06F9/5016G06F9/5027G06F9/5077G06F2009/45583
Inventor 赵军平张尧
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com