Method for training AI bot in computer game

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11253783
APP PUB NO 20200238178A1
SERIAL NO

16747403

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

The invention discloses a pure end-to-end deep reinforcement learning for training car racing game AI bot that uses only the velocity information extracted from screen for both training and testing phases without using any internal state from game environment, such as the car facing angle. The learned AI bot can play better than the average performance of human players. In addition, the reward function is designed to consist only the velocity value, and use Ape-X distributed training framework combined with a variant of Deep Q Network to solve the sparse training signal problem caused by the reward function of an original design. Moreover, limit learner rate method is designed that improves the training efficiency and training performance. The AI bot trained in this way can achieve performance beyond the average human level and reach a level close to professional players.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
KABUSHIKI KAISHA UBITUSTOKYO

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Huang, PeiWen Taipei, TW 2 8
Lin, Chiu-Chou New Taipei, TW 2 8
Lin, Kuan-Ming Taipei, TW 18 66
Tsai, Cheng-Lun New Taipei, TW 11 36
Wu, I-Chen Hsinchu County, TW 7 20
Wu, Ying-Hau Taipei, TW 3 9

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Aug 22, 2025
7.5 Year Payment $3600.00 $1800.00 $900.00 Aug 22, 2029
11.5 Year Payment $7400.00 $3700.00 $1850.00 Aug 22, 2033
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00