Cloud architecture for reinforcement learning

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 12001320
APP PUB NO 20230367697A1
SERIAL NO

17855434

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

The technology described herein provides a cloud reinforcement-learning architecture that allows a single reinforcement-learning model to interact with multiple live software environments. The live software environments and the single reinforcement-learning model run in a distributed computing environment (e.g., cloud environment). The single reinforcement-learning model may run on a first computing device(s) with a graphical processing unit (GPU) to aid in training the single reinforcement-learning model. At a high level, the single reinforcement-learning model may receive state telemetry data from the multiple live environments. The single reinforcement-learning model selects an available action for each set of state telemetry data received and communicates the selection to appropriate the test agent. The test agent then facilitates completion of the action within the software instance being tested in the live environment. A reward is then determined for the action. The single reinforcement-learning model may then be trained.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • MICROSOFT TECHNOLOGY LICENSING, LLC.

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Chapman, Timothy James Bellevue, US 9 19
Lim, Steve K Redmond, US 4 8
Liu, Xiaoyan Bothell, US 85 248
Mezquita, Marc Mas Barcelona, ES 3 7
Ozgur, Levent Seattle, US 4 8
Patel, Kashyap Maheshkumar Bellevue, US 3 7
Spangler, Taylor Paul Kirkland, US 4 8

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Dec 4, 2027
7.5 Year Payment $3600.00 $1800.00 $900.00 Dec 4, 2031
11.5 Year Payment $7400.00 $3700.00 $1850.00 Dec 4, 2035
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00