Meta tags:
description= EgoLife NTU;
Headings (most frequently used words):
multi, extremely, long, daily, life, egocentric, interpersonal, modal, view, extensive, annotation, now, please, scroll, down, and, explore, the, egohouse, enjoy,
Text of the page (most frequently used words):
and (7), multi (7), the (6), long (6), view (5), egocentric (4), hours (4), egolife (4), days (3), demo (3), with (3), modal (3), project (3), daily (3), #scroll (2), down (2), dataset (2), extensive (2), annotations (2), for (2), term (2), video (2), spanning (2), hover (2), each (2), see (2), samples (2), participants (2), synchronized (2), cameras (2), this (2), context (2), within (2), volunteers (2), shared (2), living (2), interpersonal (2), life (2), extremely (2), now, please, explore, egohouse, enjoy, includes, transcriptions, dense, captions, these, rich, are, crucial, training, our, omnimodal, egogpt, model, provide, egolifeqa, set, benchmarking, tasks, focusing, questions, requiring, information, propose, egorag, framework, solve, annotation, camera, wear, first, person, glasses, recording, gaze, imu, data, strategically, placed, gopro, system, provides, holistic, environmental, additionally, companying, scans, house, support, potential, applications, character, documents, all, engaging, chores, collaborative, activities, conversations, social, interactions, their, videos, offer, unique, insights, into, individual, perspectives, group, dynamics, environment, captures, week, experience, six, planning, party, footage, per, participant, enables, analysis, event, connections, advancing, research, understanding, towards, assistant, welcome, loading, code, blog, paper,
Text of the page (random words):
egolife paper blog demo code loading welcome to the egolife project towards extremely long egocentric interpersonal multi view multi modal daily life ai assistant scroll down extremely long daily life egolife captures a week long shared living experience of six volunteers planning a party with 50 hours of footage 7 days x 8 hours per participant this dataset enables analysis of long term event connections spanning hours and days advancing ai research in long context understanding egocentric interpersonal the project documents all volunteers engaging in daily chores collaborative activities conversations and social interactions their synchronized egocentric videos offer unique insights into individual perspectives and group dynamics within a shared living environment hover on each character to see demo samples multi modal multi view participants wear first person view glasses recording video gaze and imu data synchronized with 15 strategically placed gopro cameras this multi view multi modal system provides holistic environmental context additionally companying with multi view cameras 3d scans of the house and participants support potential 3d applications within the egolife project hover on each camera to see demo samples extensive annotation the dataset includes extensive annotations transcriptions dense captions these rich annotations are crucial for training our omnimodal egogpt model we provide a egolifeqa set for benchmarking long term egocentric video tasks focusing on questions requiring information spanning hours and days we propose egorag framework to solve it now please scroll down and explore the egohouse enjoy
|