Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data transmission and task processing method, device and equipment

A data transmission method and task processing technology, which is applied in the field of data transmission and task processing, can solve the problem of low average utilization of GPU and achieve the effects of reducing times, improving efficiency, and reducing costs

Active Publication Date: 2021-05-25
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is generally a problem that the average utilization rate of the GPU is not high during use.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data transmission and task processing method, device and equipment
  • A data transmission and task processing method, device and equipment
  • A data transmission and task processing method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0153] image 3 It is a schematic flowchart of a data transmission method provided by the embodiment of this specification. From a program perspective, the execution subject of the process may be a server applied to a GPU virtualization system.

[0154] Such as image 3 As shown, the process may include the following steps:

[0155] Step 302: Obtain the data transmission request sent by the client.

[0156] In the embodiment of this specification, the data transmission request is initiated by the application of the client, and the client receives the data transmission request initiated by the application, and then forwards the data transmission request to the server.

[0157] The data transfer request can be an independent data request, or a subtask in a task processing request. For example, if the GPU is required to complete a calculation task, the data to be calculated needs to be transmitted to the GPU address first, and then the GPU performs calculations based on the d...

Embodiment 2

[0183] Figure 4 It is a schematic flowchart of a task processing method provided by the embodiment of this specification. From a program perspective, the execution subject of the process may be a server applied to a GPU virtualization system. Such as Figure 4 As shown, the process may include the following steps:

[0184] Step 402: Obtain the task calculation request sent by the client.

[0185] Task computing requests can be various computing tasks, such as matrix multiplication, convolution, etc. The task calculation request is initiated by the application, and after the client obtains it, it forwards it to the server.

[0186] Step 404: Obtain the first virtual address in the task calculation request.

[0187] In the task calculation request, some information related to the calculation data may be included, but the task calculation request does not directly include these data, but records the address where the data is stored. Since the actual physical memory address...

Embodiment 3

[0233] Figure 6 A schematic flowchart of another data transmission method provided by the embodiment of this specification. From a program point of view, the execution subject of the process may be a client applied in the GPU virtualization system. Such as Figure 6 As shown, the process may include the following steps:

[0234] Step 602: Obtain the data transmission request sent by the application.

[0235] In this embodiment, the application and the client are together, and the data transmission request sent by the application will be transmitted through the client.

[0236] Step 604: Obtain the first virtual address in the data transmission request.

[0237] The data address in the data transmission request is a virtual address, and the client first needs to obtain the first virtual address before performing related operations.

[0238] Step 606: Based on the mapping relationship between the physical memory address and the virtual address, determine the physical memor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of this specification discloses data transmission and task processing methods, devices and equipment. The solution includes: obtaining the data transmission request sent by the client; obtaining the first virtual address in the data transmission request; obtaining the physical memory address corresponding to the first virtual address; based on the mapping relationship between the physical memory address and the virtual address, determining The second virtual address corresponding to the physical memory address; obtain the GPU address allocated for the data transfer request; generate a data copy instruction from the second virtual address to the GPU address; call the GPU-driven interface to execute the Data copy instruction.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a data transmission and task processing method, device and equipment. Background technique [0002] In the prior art, deep learning (Deep Learning, DL) is widely used in the field of artificial intelligence (AI). AI, especially deep learning, has been widely used in various scenarios such as payment (face recognition), loss assessment (picture recognition), interaction and customer service (voice recognition), and has achieved remarkable results. Typical DL tasks require powerful computing support, so most tasks currently run on acceleration devices such as Graphics Processing Units (GPUs). Accelerator chips represented by graphics processors are an important guarantee for promoting the development and implementation of AI. However, there is generally a problem that the average utilization rate of the GPU is not high during use. [0003] It is necessary to prov...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F12/109G06F12/0873
CPCG06F12/0873G06F12/109
Inventor 赵军平
Owner ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products