Selecting content items using reinforcement learning

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 10839310
APP PUB NO 20180018580A1
SERIAL NO

15212037

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a machine learning model that has been trained through reinforcement learning to select a content item. One of the methods includes receiving first data characterizing a first context in which a first content item may be presented to a first user in a presentation environment; and providing the first data as input to a long-term engagement machine learning model, the model having been trained through reinforcement learning to: receive a plurality of inputs, and process each of the plurality of inputs to generate a respective engagement score for each input that represents a predicted, time-adjusted total number of selections by the respective user of future content items presented to the respective user in the presentation environment if the respective content item is presented in the respective context.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
GOOGLE LLC1600 AMPHITHEATRE PARKWAY MOUNTAIN VIEW CA 94043

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Chu, Chia-Yueh Carlton London, GB 2 4
Cobo, Rus Luis Carlos San Francisco, US 13 40
Coppin, Benjamin Kenneth Cottenham, GB 10 174
Crespo, Jean-Francois Palo Alto, US 5 96
Mann, Timothy Harpenden, GB 44 582
Suleyman, Mustafa London, GB 15 189
Szummer, Martin London, GB 9 292
Walters, Thomas Chadwick Bromley, GB 14 78

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
7.5 Year Payment $3600.00 $1800.00 $900.00 May 17, 2028
11.5 Year Payment $7400.00 $3700.00 $1850.00 May 17, 2032
Fee Large entity fee small entity fee micro entity fee
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00