Modulating agent behavior to optimize learning progress

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 12061964
APP PUB NO 20210089908A1
SERIAL NO

17032562

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling an agent. One of the methods includes sampling a behavior modulation in accordance with a current probability distribution; for each of one or more time steps: processing an input comprising an observation characterizing a current state of the environment at the time step using an action selection neural network to generate a respective action score for each action in a set of possible actions that can be performed by the agent; modifying the action scores using the sampled behavior modulation; and selecting the action to be performed by the agent at the time step based on the modified action scores; determining a fitness measure corresponding to the sampled behavior modulation; and updating the current probability distribution over the set of possible behavior modulations using the fitness measure corresponding to the behavior modulation.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • DEEPMIND TECHNOLOGIES LIMITED

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Borsa, Diana Luiza London, GB 1 1
Dabney, William Clinton London, GB 11 85
Ding, Fengning London, GB 4 1
Osindero, Simon London, GB 17 91
Ostrovski, Georg London, GB 5 2
Schaul, Tom London, GB 20 115
Szepesvari, David London, GB 1 1

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Feb 13, 2028
7.5 Year Payment $3600.00 $1800.00 $900.00 Feb 13, 2032
11.5 Year Payment $7400.00 $3700.00 $1850.00 Feb 13, 2036
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00