Title:
REINFORCEMENT LEARNING BASED RATE CONTROL
Document Type and Number:
WIPO Patent Application WO/2022/000298
Kind Code:
A1
Abstract:
Implementations of the subject matter described herein provide a solution for rate control based on reinforcement learning. In this solution, an encoding state of a video encoder is determined, the encoding state being associated with encoding of a first video unit by the video encoder. An encoding parameter associated with rate control in the video encoder is determining by a reinforcement learning model and based on the encoding state of the video encoder. A second video unit different from the first video unit is encoded based on the encoding parameter. In this way, it is possible to achieve a better quality of experience (QOE) for real time communication with computation overhead being reduced.
Inventors:
LI JIAHAO (CN)
LI BIN (CN)
LU YAN (CN)
HOLCOMB W TOM (US)
LU MEI-HSUAN (CN)
MEZENTSEV ANDREY (US)
LEE MING-CHIEH (US)
LI BIN (CN)
LU YAN (CN)
HOLCOMB W TOM (US)
LU MEI-HSUAN (CN)
MEZENTSEV ANDREY (US)
LEE MING-CHIEH (US)
Application Number:
PCT/CN2020/099390
Publication Date:
January 06, 2022
Filing Date:
June 30, 2020
Export Citation:
Assignee:
MICROSOFT TECHNOLOGY LICENSING LLC (US)
International Classes:
H04N19/14; G06N99/00
Foreign References:
| CN109769119A | 2019-05-17 | |||
| CN108629422A | 2018-10-09 | |||
| US20160019303A1 | 2016-01-21 |
Other References:
CHENG BO; YANG JIALIN; WANG SHANGGUANG; CHEN JUNLIANG: "Adaptive Video Transmission Control System Based on Reinforcement Learning Approach Over Heterogeneous Networks", IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, vol. 12, no. 3, 1 July 2015 (2015-07-01), US , pages 1104 - 1113, XP011663831, ISSN: 1545-5955, DOI: 10.1109/TASE.2014.2387212
KAN NUOWEN; ZOU JUNNI; TANG KEXIN; LI CHENGLIN; LIU NING; XIONG HONGKAI: "Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming", ICASSP 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 12 May 2019 (2019-05-12), pages 4030 - 4034, XP033566327, DOI: 10.1109/ICASSP.2019.8683779
See also references of EP 4173291A4
KAN NUOWEN; ZOU JUNNI; TANG KEXIN; LI CHENGLIN; LIU NING; XIONG HONGKAI: "Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming", ICASSP 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 12 May 2019 (2019-05-12), pages 4030 - 4034, XP033566327, DOI: 10.1109/ICASSP.2019.8683779
See also references of EP 4173291A4
Attorney, Agent or Firm:
KING & WOOD MALLESONS (CN)
Download PDF: