High-speed real-time scene reconstruction from input image data

Number of patents in Portfolio can not be more than 2000

United States of America

PATENT NO 12159358
APP PUB NO 20230196690A1
SERIAL NO

18080910

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A scene reconstruction model is disclosed that outputs a heightfield for a series of input images. The model, for each input image, predicts a depth map and extracts a feature map. The model builds a 3D model utilizing the predicted depth maps and camera poses for the images. The model raycasts the 3D model to determine a raw heightfield for the scene. The model utilizes the raw heightfield to sample features from the feature maps corresponding to positions on the heightfield. The model aggregates the sampled features into an aggregate feature map. The model regresses a refined heightfield based on the aggregate feature map. The model determines the final heightfield based on a combination of the raw heightfield and the refined heightfield. With the final heightfield, a client device may generate virtual content augmented on real-world images captured by the client device.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
NIANTIC SPATIAL INCONE FERRY BUILDING SUITE 200 SAN FRANCISCO CA 94111

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Brostow, Gabriel J London, GB 22 64
Firman, Michael David London, GB 15 21
Godard, Clément San Francisco, US 8 90
MacAodha, Oisin Edinburgh, GB 6 1
Vicente, Sara Alexandra Gomes London, GB 5 3
Watson, James London, GB 113 2745

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Jun 3, 2028
7.5 Year Payment $3600.00 $1800.00 $900.00 Jun 3, 2032
11.5 Year Payment $7400.00 $3700.00 $1850.00 Jun 3, 2036
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00