LIGHTWEIGHT REAL-TIME EMOTION ANALYSIS METHOD INCORPORATING EYE TRACKING
Number of patents in Portfolio can not be more than 2000
United States of America Patent
Stats
-
N/A
Issued Date -
Oct 24, 2024
app pub date -
Jun 20, 2022
filing date -
Jun 20, 2022
priority date (Note) -
Published
status (Latency Note)
Importance
Abstract
The present invention belongs to the technical field of computer vision, and proposes a lightweight real-time emotion analysis method incorporating eye tracking. In the method, gray frames and event frames that have synchronized time are acquired through event-based cameras and respectively input to a frame branch and an event branch; the frame branch extracts spatial features by convolution operations, and the event branch extracts temporal features through conv-SNN blocks; the frame branch has a guide attention mechanism for the event branch; and the spatial features and the temporal features are integrated by fully connected layers, The final output is the average of the n fully connected layer outputs, which represents the final expression. The method can recognize the emotional expression of any stage in various complex light changing scenarios; and in the case of limited accuracy loss, the emotion recognition time is shortened to achieve “real-time” user emotion analysis.
First Claim
Family
International Classification(s)
Cited Art Landscape
Patent Citation Ranking
Recipient Email Address
Recipient Email Address
Comment
Recipient Email Address
Add to Portfolio(s)
To add this patent to one, or more, of your portfolios, simply click the add button.
This Patent is in these Portfolios:
Add to additional portfolios:
Last Refreshed On:
Changes done successfully