Title:
GPU RESOURCE USAGE METHOD, GPU VIRTUALIZATION METHOD, AND JOB SCHEDULING APPARATUS AND CLUSTER
Document Type and Number:
WIPO Patent Application WO/2024/032587
Kind Code:
A1
Abstract:
A GPU resource usage method, a virtualization method, and a job scheduling apparatus and a cluster. The GPU resource usage method comprises: slicing a GPU into a plurality of virtual GPUs; for at least one virtual GPU, taking at least part of a host memory as a video memory exchange area, and allocating same to the virtual GPU, such that the available video memory of the virtual GPU is greater than the on-board video memory of the virtual GPU; and replacing a video memory application request of an application or task for the virtual GPU with a video memory application request based on a unified address space, such that at least part of data in the on-board video memory can be exchanged to the video memory exchange area on the basis of the unified address space when the currently available on-board video memory of the virtual GPU is insufficient. By means of the method, a video memory exchange area may serve as a virtual video memory to increase the available thread of a virtual GPU, thereby solving the problem of it being impossible to balance the computing power utilization rate and video memory utilization rate of a GPU; in addition, a video memory application request of an application or task for a virtual GPU is replaced with a video memory application request based on an unified address space, such that the application or task can use a virtual video memory without perception.
Inventors:
LI MENGXUAN (CN)
ZHANG GUANYI (CN)
ZHANG GUANYI (CN)
Application Number:
PCT/CN2023/111673
Publication Date:
February 15, 2024
Filing Date:
August 08, 2023
Export Citation:
Assignee:
FOURTH PARADIGM BEIJING TECH CO LTD (CN)
International Classes:
G06F9/50
Foreign References:
| CN111223036A | 2020-06-02 | |||
| US20160188251A1 | 2016-06-30 | |||
| US20210133123A1 | 2021-05-06 | |||
| US20210208951A1 | 2021-07-08 |
Other References:
ANONYMOUS: "Taking stock of GPU sharing solutions from the industry", QIONGLING TECHNOLOGY, 31 August 2021 (2021-08-31), XP093138346, Retrieved from the Internet [retrieved on 20240306]
Attorney, Agent or Firm:
ZYX INTELLECTUAL PROPERTY LAW FIRM (CN)
Download PDF: