Discovery of semantic similarities between images and text

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 9836671
SERIAL NO

14839430

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Disclosed herein are technologies directed to discovering semantic similarities between images and text, which can include performing image search using a textual query, performing text search using an image as a query, and/or generating captions for images using a caption generator. A semantic similarity framework can include a caption generator and can be based on a deep multimodal similar model. The deep multimodal similarity model can receive sentences and determine the relevancy of the sentences based on similarity of text vectors generated for one or more sentences to an image vector generated for an image. The text vectors and the image vector can be mapped in a semantic space, and their relevance can be determined based at least in part on the mapping. The sentence associated with the text vector determined to be the most relevant can be output as a caption for the image.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
MICROSOFT TECHNOLOGY LICENSING LLCONE MICROSOFT WAY REDMOND WA 98052

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Deng, Li Redmond, US 180 5784
Fang, Hao Seattle, US 127 1556
Gao, Jianfeng Woodinville, US 157 5455
Gupta, Saurabh Berkeley, US 279 2074
He, Xiaodong Sammamish, US 69 2339
Iandola, Forrest Berkeley, US 2 96
Mitchell, Margaret A Seattle, US 1 93
Platt, John C Bellevue, US 133 10416
Srivastava, Rupesh Kumar Lugano, CH 4 100
Zweig, Geoffrey G Sammamish, US 22 1207

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
7.5 Year Payment $3600.00 $1800.00 $900.00 Jun 5, 2025
11.5 Year Payment $7400.00 $3700.00 $1850.00 Jun 5, 2029
Fee Large entity fee small entity fee micro entity fee
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00