TOKEN-WISE TRAINING FOR ATTENTION BASED END-TO-END SPEECH RECOGNITION

Number of patents in Portfolio can not be more than 2000

United States of America Patent

APP PUB NO 20210264901A1
SERIAL NO

17316856

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A method of attention-based end-to-end (A-E2E) automatic speech recognition (ASR) training, includes performing cross-entropy training of a model, based on one or more input features of a speech signal, determining a posterior probability vector at a time of a first wrong token among one or more output tokens of the model of which the cross-entropy training is performed, and determining a loss of the first wrong token at the time, based on the determined posterior probability vector. The method further includes determining a total loss of a training set of the model of which the cross-entropy training is performed, based on the determined loss of the first wrong token, and updating the model of which the cross-entropy training is performed, based on the determined total loss of the training set.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
TENCENT AMERICA LLC2747 PARK BOULEVARD PALO ALTO CA 94306 UNITED STATES OF AMERICA

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
CUI, Jia Bellevue, US 12 28
WANG, Peidong Columbus, US 67 986
WENG, Chao Fremont, US 42 169
YU, Dong Bothell, US 354 6818

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation