Scheduling neural network processing
Number of patents in Portfolio can not be more than 2000
United States of America
Stats
-
Mar 18, 2025
Grant Date -
May 19, 2022
app pub date -
Oct 25, 2021
filing date -
Oct 25, 2021
priority date (Note) -
In Force
status (Latency Note)
Importance
Abstract
A computer-implemented method includes receiving a batch of neural network inputs to be processed using a neural network on a hardware circuit. The neural network has multiple layers arranged in a directed graph and each layer has a respective set of parameters. The method includes determining a partitioning of the neural network layers into a sequence of superlayers. Each superlayer is a partition of the directed graph that includes one or more layers. The method includes processing the batch of inputs using the hardware circuit, which includes, for each superlayer in the sequence: i) loading the respective set of parameters for the layers in the superlayer into memory of the hardware circuit, and ii) for each input in the batch, processing the input through each of the layers in the superlayer using the parameters in the memory of the hardware circuit to generate a superlayer output for the input.
First Claim
Other Claims data not available
Family
International Classification(s)
- 2021 Application Filing Year
- G06N Class
- 16935 Applications Filed
- 6768 Patents Issued To-Date
- 39.97 % Issued To-Date
Cited Art Landscape
Patent Citation Ranking
- 0 Citation Count
- G06N Class
- 0 % this patent is cited more than
- < 1 Age
Maintenance Fees
| Fee | Large entity fee | small entity fee | micro entity fee | due date |
|---|---|---|---|---|
| 3.5 Year Payment | $1600.00 | $800.00 | $400.00 | Sep 18, 2028 |
| 7.5 Year Payment | $3600.00 | $1800.00 | $900.00 | Sep 18, 2032 |
| 11.5 Year Payment | $7400.00 | $3700.00 | $1850.00 | Sep 18, 2036 |