Title:
ARITHMETIC PROGRAM, ARITHMETIC METHOD AND ARITHMETIC DEVICE
Document Type and Number:
Japanese Patent JP2023039558
Kind Code:
A
Abstract:
To quantize a tensor without changing mathematical characteristics of the tensor.SOLUTION: An arithmetic device projects a maximum absolute value in a direction of each dimension to identify a maximum absolute value of each dimension for a tensor expressed in a multidimensional array and having a value set to each element of the array. The arithmetic device identifies a minimum value indicating the minimum maximum absolute value among the maximum absolute values of the respective dimensions. The arithmetic device sets a range of quantization for the tensor on the basis of the minimum value.SELECTED DRAWING: Figure 5
Inventors:
TAMIYA YUTAKA
Application Number:
JP2021146728A
Publication Date:
March 22, 2023
Filing Date:
September 09, 2021
Export Citation:
Assignee:
FUJITSU LTD
International Classes:
G06F17/16
Attorney, Agent or Firm:
Sakai International Patent Office