METHODS, SYSTEMS, APPARATUSES, AND DEVICES FOR FACILITATING SIFR OPTIMIZER-BASED EFFICIENT TRAINING OF NEURAL NETWORK MODELS
Number of patents in Portfolio can not be more than 2000
United States of America
Stats
-
N/A
Issued Date -
Apr 10, 2025
app pub date -
Nov 26, 2024
filing date -
Nov 26, 2024
priority date (Note) -
Published
status (Latency Note)
Importance
Abstract
A method for training a neural network model having layers and parameters. The method includes providing an input to an input layer of the layers. The input corresponds to a batch of samples from a training dataset. The method includes obtaining outputs from the neural network model based on the input. The method includes calculating a loss function based on the outputs and corresponding desired values for the batch of samples. The method includes obtaining a curvature data representing a second order information about a loss function landscape based on the loss function. The curvature data includes at least one of a covariance matrix and a Gram matrix of the batch of samples. The method includes generating a Sifr update for optimizing at least one of the parameters based on the curvature data. The training of the neural network model is based on the Sifr update.
First Claim
Family
International Classification(s)
Cited Art Landscape
Patent Citation Ranking
Recipient Email Address
Recipient Email Address
Comment
Recipient Email Address
Add to Portfolio(s)
To add this patent to one, or more, of your portfolios, simply click the add button.
This Patent is in these Portfolios:
Add to additional portfolios:
Last Refreshed On:
Changes done successfully