One model unifying streaming and non-streaming speech recognition

Number of patents in Portfolio can not be more than 2000

United States of America

PATENT NO 12254869
APP PUB NO 20230368779A1
SERIAL NO

18357225

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A transformer-transducer model for unifying streaming and non-streaming speech recognition includes an audio encoder, a label encoder, and a joint network. The audio encoder receives a sequence of acoustic frames, and generates, at each of a plurality of time steps, a higher order feature representation for a corresponding acoustic frame. The label encoder receives a sequence of non-blank symbols output by a final softmax layer, and generates, at each of the plurality of time steps, a dense representation. The joint network receives the higher order feature representation and the dense representation at each of the plurality of time steps, and generates a probability distribution over possible speech recognition hypothesis. The audio encoder of the model further includes a neural network having an initial stack of transformer layers trained with zero look ahead audio context, and a final stack of transformer layers trained with a variable look ahead audio context.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • GOOGLE LLC

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Kim, Jaeyoung Cupertino, US 214 1779
Lu, Han Redmond, US 46 229
Sak, Hasim Santa Clara, US 46 1464
Tripathi, Anshuman Mountain View, US 46 468
Zhang, Qian Mountain View, US 942 7505

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Sep 18, 2028
7.5 Year Payment $3600.00 $1800.00 $900.00 Sep 18, 2032
11.5 Year Payment $7400.00 $3700.00 $1850.00 Sep 18, 2036
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00