Meta tags:
description= DESCRIPTION META TAG;
keywords= KEYWORDS SHOULD BE PLACED HERE;
Headings (most frequently used words):
two, hand, interaction, generation, interhandgen, cascaded, diffusion, object, in, learning, or, an, via, reverse, abstract, the, wild, reconstruction, from, rgb, formula, and, network, architecture, bibtex, generates, interactions, with, without, using, novel, this, generative, prior, can, be, incorporated, into, any, optimization, methods, to, reduce, ambiguity, ill, posed, setup,
Text of the page (most frequently used words):
the (23), hand (21), two (15), and (14), interhandgen (8), interaction (7), #generation (7), distribution (7), our (6), that (6), modeling (6), learning (6), can (6), from (5), via (5), diffusion (5), into (5), mathbf (5), prior (5), object (5), single (4), model (4), unconditional (4), conditional (4), reconstruction (4), plausible (4), this (3), page (3), using (3), cascaded (3), joint (3), phi (3), reduce (3), incorporated (3), any (3), optimization (3), methods (3), sampling (3), wild (3), diverse (3), interactions (3), with (3), generative (3), was (2), project (2), reverse (2), lee (2), jihyun (2), saito (2), shunsuke (2), nam (2), giljoo (2), sung (2), minhyuk (2), kim (2), tae (2), kyun (2), cvpr (2), 2024 (2), key (2), observation (2), directly (2), multiple (2), instances (2), imposes (2), high (2), complexity (2), due (2), its (2), combinatorial (2), nature (2), thus (2), factored (2), conditioning (2), dropout (2), network (2), new (2), state (2), art (2), accuracy (2), images (2), also (2), paper (2), for (2), where (2), establish (2), rigorous (2), evaluation (2), protocol (2), synthesis (2), novel (2), learns (2), without (2), ambiguity (2), ill (2), posed (2), setup (2), built, which, adopted, website, licensed, under, creative, commons, attribution, sharealike, international, license, nerfies, academic, template, inproceedings, lee2024interhandgen, title, author, booktitle, year, bibtex, reformulate, other, such, dimensionality, each, target, after, normalizing, side, jointly, learn, resulting, distributions, formula, architecture, score, distillation, like, loss, achieves, rgb, leraning, formulation, easily, extended, conditioned, shown, bimanual, generate, please, refer, quantitative, comparisons, baselines, present, framework, yields, shapes, close, propose, particular, introduce, another, combine, anti, penetration, classifier, free, guidance, enable, furthermore, method, significantly, outperforms, baseline, models, terms, plausibility, diversity, demonstrate, boost, performance, monocular, achieving, decompose, instance, abstract, generates, code, arxiv, kaist, codec, avatars, lab, meta, imperial, college, london,
Text of the page (random words):
interhandgen interhandgen two hand interaction generation via cascaded reverse diffusion jihyun lee 1 shunsuke saito 2 giljoo nam 2 minhyuk sung 1 tae kyun kim 1 3 kaist 1 codec avatars lab meta 2 imperial college london 3 cvpr 2024 paper arxiv code interhandgen generates two hand interactions with or without an object using a novel cascaded diffusion this generative prior can be incorporated into any optimization or learning methods to reduce ambiguity in an ill posed setup abstract we present interhandgen a novel framework that learns the generative prior of two hand interaction sampling from our model yields plausible and diverse two hand shapes in close interaction with or without an object our prior can be incorporated into any optimization or learning methods to reduce ambiguity in an ill posed setup our key observation is that directly modeling the joint distribution of multiple instances imposes high learning complexity due to its combinatorial nature thus we propose to decompose the modeling of joint distribution into the modeling of factored unconditional and conditional single instance distribution in particular we introduce a diffusion model that learns the single hand distribution unconditional and conditional to another hand via conditioning dropout for sampling we combine anti penetration and classifier free guidance to enable plausible generation furthermore we establish the rigorous evaluation protocol of two hand synthesis where our method significantly outperforms baseline generative models in terms of plausibility and diversity we also demonstrate that our diffusion prior can boost the performance of two hand reconstruction from monocular in the wild images achieving new state of the art accuracy two hand interaction generation interhandgen can generate plausible and diverse two hand interactions please also refer to the paper for quantitative comparisons with baselines where we establish the rigorous evaluation protocol of two hand synthesis ️ two hand object interaction generation the leraning formulation of interhandgen can be easily extended to object conditioned two hand interaction generation it is shown to model plausible and diverse bimanual hand object interactions in the wild two hand reconstruction from rgb interhandgen can be incorporated as a prior into any optimization or learning methods via score distillation sampling like loss it achieves new state of the art reconstruction accuracy on two hand reconstruction from in the wild images learning formula and network architecture our key observation is that directly modeling the joint distribution of multiple instances imposes high learning complexity due to its combinatorial nature thus we reformulate the two hand distribution modeling into the modeling of factored single hand model distribution unconditional and conditional to the other hand such that p_ phi mathbf x _ l mathbf x _ r p_ phi mathbf x _ l p_ phi mathbf x _ r mathbf x _ l to reduce the dimensionality of each generation target after normalizing hand side we jointly learn the resulting unconditional and conditional distributions via conditioning dropout using a single network bibtex inproceedings lee2024interhandgen title interhandgen two hand interaction generation via cascaded reverse diffusion author lee jihyun and saito shunsuke and nam giljoo and sung minhyuk and kim tae kyun booktitle cvpr year 2024 this page was built using the academic project page template which was adopted from the nerfies project page this website is licensed under a creative commons attribution sharealike 4 0 international license
|
