Mixture model attention for flexible streaming and non-streaming automatic speech recognition

Number of patents in Portfolio can not be more than 2000

United States of America

PATENT NO 12136415
APP PUB NO 20220310073A1
SERIAL NO

17644343

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A method for an automated speech recognition (ASR) model for unifying streaming and non-streaming speech recognition including receiving a sequence of acoustic frames. The method includes generating, using an audio encoder of an automatic speech recognition (ASR) model, a higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The method further includes generating, using a joint encoder of the ASR model, a probability distribution over possible speech recognition hypothesis at the corresponding time step based on the higher order feature representation generated by the audio encoder at the corresponding time step. The audio encoder comprises a neural network that applies mixture model (MiMo) attention to compute an attention probability distribution function (PDF) using a set of mixture components of softmaxes over a context window.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • GOOGLE LLC

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Audhkhasi, Kartik Mountain View, US 25 364
Chen, Tongzhou Mountain View, US 7 11
Moreno, Mengibar Pedro J Jersey City, US 67 1801
Ramabhadran, Bhuvana Mt. Kisco, US 125 2541

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 May 5, 2028
7.5 Year Payment $3600.00 $1800.00 $900.00 May 5, 2032
11.5 Year Payment $7400.00 $3700.00 $1850.00 May 5, 2036
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00