Method and system for controlling heavy-haul train based on reinforcement learning

Number of patents in Portfolio can not be more than 2000

United States of America

PATENT NO 11205124
SERIAL NO

17186795

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

The present disclosure provides a method and system for controlling a heavy-haul train based on reinforcement learning. The method includes: obtaining operation state information of a heavy-haul train at a current time point; obtaining a heavy-haul train action of a next time point according to the operation state information of the heavy-haul train at the current time point and a heavy-haul train virtual controller, and sending the heavy-haul train action of the next time point to a heavy-haul train control unit to control operation of the heavy-haul train. The heavy-haul train virtual controller is obtained by training a reinforcement learning network according to operation state data of the heavy-haul train and an expert strategy network; the reinforcement learning network includes one actor network and two critic networks; the reinforcement learning network is constructed according to a soft actor-critic (SAC) reinforcement learning algorithm.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
EAST CHINA JIAOTONG UNIVERSITY330013 JIANGXI CITY OF NANCHANG PROVINCE EAST SHUANGGANG STREET NO 808 NANCHANG CITY JIANGXI PROVINCE 330013

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Fu, Yating Nanchang, CN 4 5
Li, Zhongqi Nanchang, CN 7 6
Tan, Chang Nanchang, CN 8 49
Wang, Yu Nanchang, CN 1481 8143
Yang, Hui Nanchang, CN 265 893

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Jun 21, 2025
7.5 Year Payment $3600.00 $1800.00 $900.00 Jun 21, 2029
11.5 Year Payment $7400.00 $3700.00 $1850.00 Jun 21, 2033
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00