Automated software testing with reinforcement learning

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 12066920
APP PUB NO 20230367703A1
SERIAL NO

17854640

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

The technology described herein provides an automated software-testing platform that uses reinforcement learning to discover how to perform tasks used in testing. The technology described herein is able to perform quality testing even when prescribed paths to completing tasks are not provided. The reinforcement-learning agent is not directly supervised to take actions in any given situation, but rather learns which sequences of actions generate the most rewards through the observed states and rewards from the environment. In the software-testing environment, the state can be user interface features and actions are interactions with user interface elements. The testing system may recognize when a sought after state is achieved by comparing a new state to a reward criteria.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • MICROSOFT TECHNOLOGY LICENSING, LLC.

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Chapman, Timothy James Bellevue, US 9 19
Lim, Steve K Redmond, US 4 8
Liu, Xiaoyan Bothell, US 85 248
Mezquita, Marc Mas Redmond, US 3 7
Ozgur, Levent Seattle, US 4 8
Patel, Kashyap Maheshkumar Bellevue, US 3 7
Spangler, Taylor Paul Kirkland, US 4 8

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Feb 20, 2028
7.5 Year Payment $3600.00 $1800.00 $900.00 Feb 20, 2032
11.5 Year Payment $7400.00 $3700.00 $1850.00 Feb 20, 2036
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00