Method of bidirectional image-text retrieval based on multi-view joint embedding space

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11106951
SERIAL NO

16622570

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A bidirectional image-text retrieval method based on a multi-view joint embedding space includes: performing retrieval with reference to a semantic association relationship at a global level and a local level, obtaining the semantic association relationship at the global level and the local level in a frame-sentence view and a region-phrase view, and obtaining semantic association information in a global level subspace of frame and sentence in the frame-sentence view, obtaining semantic association information in a local level subspace of region and phrase in the region-phrase view, processing data by a dual-branch neural network in the two views to obtain an isomorphic feature and embedding the same in a common space, and using a constraint condition to reserve an original semantic relationship of the data during training, and merging the two semantic association relationships using multi-view merging and sorting to obtain a more accurate semantic similarity between data.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
PEKING UNIVERSITY SHENZHEN GRADUATE SOHOOLSHENZHEN

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Dong, Shengfu Shenzhen, CN 22 138
Gao, Wen Shenzhen, CN 329 3875
Li, Ge Shenzhen, CN 125 1180
Li, Ying Shenzhen, CN 869 31412
Ran, Lu Shenzhen, CN 1 3
Wang, Ronggang Shenzhen, CN 78 337
Wang, Wenmin Shenzhen, CN 32 217
Wang, Zhenyu Shenzhen, CN 189 678
Zhao, Hui Shenzhen, CN 245 1011

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Feb 28, 2025
7.5 Year Payment $3600.00 $1800.00 $900.00 Feb 28, 2029
11.5 Year Payment $7400.00 $3700.00 $1850.00 Feb 28, 2033
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00