Meta tags:
description= SV4D generates novel multi-view video synthesis from a single reference video.;
keywords= Video Diffusion, 4D Generation, NeRF;
Headings (most frequently used words):
and, sv4d, view, video, multi, novel, 4d, results, dynamic, 3d, content, generation, with, frame, consistency, takes, reference, as, input, generates, videos, models, abstract, summary, comparison, more, generated, by, bibtex, synthesis, optimization,
Text of the page (most frequently used words):
and (13), view (11), video (10), sv4d (8), multi (8), novel (8), dynamic (7), #generation (7), the (5), with (5), frame (5), #results (5), content (4), model (4), for (4), consistency (3), arxiv (3), our (3), synthesis (3), videos (3), based (2), from (2), yiming (2), xie (2), chun (2), han (2), yao (2), vikram (2), voleti (2), huaizu (2), jiang (2), varun (2), jampani (2), generated (2), comparing (2), baselines (2), optimization (2), diffusion (2), consistent (2), that (2), models (2), unified (2), reference (2), generates (2), prior (2), works (2), dataset (2), equal (2), this, website, template, nerfies, article, xie2024sv4d, title, author, journal, preprint, 2407, 17470, year, 2024, bibtex, more, comparison, summary, present, stable, latent, unlike, previous, methods, rely, separately, trained, generative, design, generate, objects, specifically, given, monocular, views, each, are, temporally, then, use, optimize, implicit, representation, nerf, efficiently, without, need, cumbersome, sds, used, most, train, curated, object, existing, objaverse, extensive, experimental, multiple, datasets, user, studies, demonstrate, state, art, performance, well, compared, abstract, takes, input, blog, code, advising, contribution, northeastern, university, stability,
Text of the page (random words):
sv4d dynamic 3d content generation with multi frame and multi view consistency sv4d dynamic 3d content generation with multi frame and multi view consistency yiming xie 1 2 chun han yao 1 vikram voleti 1 huaizu jiang 2 varun jampani 1 1 stability ai 2 northeastern university equal contribution equal advising arxiv model code blog sv4d takes a reference video as input and generates novel view videos and 4d models abstract we present stable video 4d sv4d a latent video diffusion model for multi frame and multi view consistent dynamic 3d content generation unlike previous methods that rely on separately trained generative models for video generation and novel view synthesis we design a unified diffusion model to generate novel view videos of dynamic 3d objects specifically given a monocular reference video sv4d generates novel views for each video frame that are temporally consistent we then use the generated novel view videos to optimize an implicit 4d representation dynamic nerf efficiently without the need for cumbersome sds based optimization used in most prior works to train our unified novel view video generation model we curated a dynamic 3d object dataset from the existing objaverse dataset extensive experimental results on multiple datasets and user studies demonstrate sv4d s state of the art performance on novel view video synthesis as well as 4d generation compared to prior works summary video results and comparison novel view video synthesis comparing our results with baselines 4d optimization comparing our results with baselines more results generated by sv4d bibtex article xie2024sv4d title sv4d dynamic 3d content generation with multi frame and multi view consistency author yiming xie and chun han yao and vikram voleti and huaizu jiang and varun jampani journal arxiv preprint arxiv 2407 17470 year 2024 this website is based on the template from nerfies
|