Executing large artificial intelligence models on memory-constrained devices

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11520592
APP PUB NO 20210019151A1
SERIAL NO

16577779

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods, systems, apparatuses, and computer program products are described herein that enable execution of a large AI model on a memory-constrained target device that is communicatively connected to a parameter server, which stores a master copy of the AI model. The AI model may be dissected into smaller portions (e.g., layers or sub-layers), and each portion may be executed as efficiently as possible on the target device. After execution of one portion of the AI model is finished, another portion of the AI model may be downloaded and executed at the target device. To improve efficiency, the input samples may be divided into microbatches, and a plurality of microbatches executing in sequential order may form a minibatch. The size of the group of microbatches or minibatch can be manually or automatically adjusted to reduce the communication overhead.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
MICROSOFT TECHNOLOGY LICENSING LLCONE MICROSOFT WAY REDMOND WA 98052

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Mesmakhosroshahi, Maral Sunnyvale, US 15 81
Mitra, Tiyasa San Jose, US 22 25
Mittal, Mohit San Jose, US 11 40
Popuri, Gautham Sunnyvale, US 2 5
Pudipeddi, Bharadwaj San Jose, US 29 112
Rashid, Layali Issaquah, US 3 7
Tremblay, Marc Bellevue, US 273 6180

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Jun 6, 2026
7.5 Year Payment $3600.00 $1800.00 $900.00 Jun 6, 2030
11.5 Year Payment $7400.00 $3700.00 $1850.00 Jun 6, 2034
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00