Long Running Language Model Thread Truncation
Number of patents in Portfolio can not be more than 2000
United States of America
Stats
-
N/A
Issued Date -
Apr 3, 2025
app pub date -
Oct 2, 2023
filing date -
Oct 2, 2023
priority date (Note) -
Published
status (Latency Note)
Importance
Abstract
Techniques for truncating long running language model conversation threads are provided. In one aspect, a language model thread truncation system includes: a language model; and a thread truncation module configured to obtain prompts and responses from a thread of user interactions with the language model during a conversation, cluster the prompts and responses based on their topical representation to create a cluster around a topic, and after a timing threshold has been reached, truncate the thread by removing the cluster from the thread if the current topic of the conversation differs from the topic of the cluster and if a reference value of the cluster is below a minimum value, otherwise retain the cluster in the thread. The reference value of the cluster can be determined based on individual reference scores for the prompts and responses in the cluster. A method for language model thread truncation is also provided.
First Claim
Family
International Classification(s)
Cited Art Landscape
Patent Citation Ranking
Recipient Email Address
Recipient Email Address
Comment
Recipient Email Address
Add to Portfolio(s)
To add this patent to one, or more, of your portfolios, simply click the add button.
This Patent is in these Portfolios:
Add to additional portfolios:
Last Refreshed On:
Changes done successfully