Use of small unit language model for training large unit language models
Number of patents in Portfolio can not be more than 2000
United States of America Patent
Stats
-
Nov 10, 2020
Grant Date -
Sep 5, 2019
app pub date -
Mar 1, 2018
filing date -
Mar 1, 2018
priority date (Note) -
In Force
status (Latency Note)
Importance
Abstract
A computer-implemented method, computer program product, and apparatus are provided. The method includes generating a plurality of sequences of small unit tokens from a first language model that is trained with a small unit corpus including the small unit tokens, the small unit corpus having been derived by tokenization with a small unit. The method further includes tokenizing the plurality of sequences of small unit tokens by a large unit that is larger than the small unit, to create a derived large unit corpus including derived large unit tokens.
First Claim
Family
International Classification(s)
Cited Art Landscape
Patent Citation Ranking
Recipient Email Address
Recipient Email Address
Comment
Recipient Email Address
Add to Portfolio(s)
To add this patent to one, or more, of your portfolios, simply click the add button.
This Patent is in these Portfolios:
Add to additional portfolios:
Last Refreshed On:
Changes done successfully