Title:
FEDERATED DISTILLATION-BASED LEARNING DRIVING METHOD, LEARNING DRIVING SERVER, AND LEARNING DRIVING TERMINAL
Document Type and Number:
WIPO Patent Application WO/2021/149845
Kind Code:
A1
Abstract:
According to the present invention, disclosed are a learning driving method, a learning driving server, and a learning driving terminal based on federated distillation, in which: a terminal collects data samples to calculate a local average logit, and transmits the local average logit and seed samples to an uplink of a server; and the server performs distillation of a global model on the basis of the seed samples and the local average logit, thereby solving privacy and communication overhead problems occurring in a distributed network.
Inventors:
KIM SEONG LYUN (KR)
OH SEUNG EUN (KR)
JEONG EUN JEONG (KR)
KIM HYE SUNG (KR)
OH SEUNG EUN (KR)
JEONG EUN JEONG (KR)
KIM HYE SUNG (KR)
Application Number:
PCT/KR2020/001021
Publication Date:
July 29, 2021
Filing Date:
January 21, 2020
Export Citation:
Assignee:
UNIV INDUSTRY FOUNDATION UIF YONSEI UNIV (KR)
International Classes:
G06N3/04; G06N3/08; G06N20/00; H04L29/08
Foreign References:
| US20190340534A1 | 2019-11-07 | |||
| KR20200083234A | 2020-07-08 |
Other References:
JIHONG PARK; SHIQIANG WANG; ANIS ELGABLI; SEUNGEUN OH; EUNJEONG JEONG; HAN CHA; HYESUNG KIM; SEONG-LYUN KIM; MEHDI BENNIS: "Distilling On-Device Intelligence at the Network Edge", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 16 August 2019 (2019-08-16), 201 Olin Library Cornell University Ithaca, NY 14853, XP081464370
EUNJEONG JEONG; SEUNGEUN OH; HYESUNG KIM; JIHONG PARK; MEHDI BENNIS; SEONG-LYUN KIM: "Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 28 November 2018 (2018-11-28), 201 Olin Library Cornell University Ithaca, NY 14853, XP080939896
PARK JIHONG; SAMARAKOON SUMUDU; BENNIS MEHDI; DEBBAH MEROUANE: "Wireless Network Intelligence at the Edge", PROCEEDINGS OF THE IEEE., IEEE. NEW YORK., US, vol. 107, no. 11, 1 November 2019 (2019-11-01), US, pages 2204 - 2239, XP011751692, ISSN: 0018-9219, DOI: 10.1109/JPROC.2019.2941458
EUNJEONG JEONG; SEUNGEUN OH; JIHONG PARK; HYESUNG KIM; MEHDI BENNIS; SEONG-LYUN KIM: "Multi-hop Federated Private Data Augmentation with Sample Compression", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 July 2019 (2019-07-15), 201 Olin Library Cornell University Ithaca, NY 14853, XP081442054
EUNJEONG JEONG; SEUNGEUN OH; HYESUNG KIM; JIHONG PARK; MEHDI BENNIS; SEONG-LYUN KIM: "Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 28 November 2018 (2018-11-28), 201 Olin Library Cornell University Ithaca, NY 14853, XP080939896
PARK JIHONG; SAMARAKOON SUMUDU; BENNIS MEHDI; DEBBAH MEROUANE: "Wireless Network Intelligence at the Edge", PROCEEDINGS OF THE IEEE., IEEE. NEW YORK., US, vol. 107, no. 11, 1 November 2019 (2019-11-01), US, pages 2204 - 2239, XP011751692, ISSN: 0018-9219, DOI: 10.1109/JPROC.2019.2941458
EUNJEONG JEONG; SEUNGEUN OH; JIHONG PARK; HYESUNG KIM; MEHDI BENNIS; SEONG-LYUN KIM: "Multi-hop Federated Private Data Augmentation with Sample Compression", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 July 2019 (2019-07-15), 201 Olin Library Cornell University Ithaca, NY 14853, XP081442054
Attorney, Agent or Firm:
WOOIN PATENT & LAW FIRM (KR)
Download PDF: