Meta tags:
Headings (most frequently used words):
compose, environments, polaris, hub, roboarena, correlation,
Text of the page (most frequently used words):
and (25), polaris (14), for (13), real (10), sim (6), #environments (6), simulation (6), object (6), university (6), evaluation (5), the (5), rollouts (5), training (5), with (5), world (5), viewer (5), gaussian (5), evaluations (4), robot (4), policies (4), sergey (4), from (4), scalable (3), generalist (3), interactive (3), simulated (3), data (3), correlation (3), roboarena (3), policy (3), scores (3), are (3), splat (3), scan (3), reconstruction (3), step (3), code (2), arhan (2), jain (2), mingtong (2), zhang (2), kanav (2), arora (2), william (2), chen (2), marcel (2), torne (2), muhammad (2), zubair (2), irshad (2), zakharov (2), yue (2), wang (2), levine (2), chelsea (2), finn (2), wei (2), chiu (2), dhruv (2), shah (2), abhishek (2), gupta (2), karl (2), pertsch (2), 2512 (2), 16881 (2), arxiv (2), see (2), more (2), contribution (2), tool (2), resources (2), diverse (2), loading (2), videos (2), also (2), progress (2), correlate (2), performance (2), based (2), task (2), results (2), select (2), scene (2), mesh (2), cleaner (2), trellis (2), generated (2), meshes (2), side (2), aware (2), splatting (2), environment (2), pipeline (2), video (2), california (2), equal (2), team, source, available, here, misc, jain2025polarisscalablerealtosimevaluations, title, author, year, 2025, eprint, archiveprefix, primaryclass, url, https, org, abs, reference, bibtex, hugging, face, download, our, contribute, your, own, details, guide, hub, launch, composing, configuring, reconstructed, scenes, compose, visual, alignment, samples, including, improves, mix, ablation, key, insight, sample, same, learn, about, this, validates, that, rankings, align, human, judgments, quality, strongly, below, ctrl, comparison, all, metrics, normalized, per, pair, not, supported, mobile, please, visit, desktop, lobby, desk, stove, workbench, drag, scroll, rotate, zoom, showing, spoon, scissor, pot, coke, electric, drill, generation, explore, reconstructions, robots, articulated, kinematics, splats, objects, multiview, images, made, physics, ready, insertion, 2dgs, recovers, photorealistic, visuals, extract, collision, contact, neural, minute, camera, captures, geometry, appearance, charuco, metric, scale, minimal, user, effort, eval, approach, constructing, high, fidelity, framework, quickly, turns, short, into, use, create, suite, demonstrate, strong, correlations, read, paper, washington, princeton, berkeley, stanford, toyota, research, institute, southern, cornell, physical, intelligence, advising, zero, shot, intro,
Text of the page (random words):
polaris intro pipeline results co training resources polaris scalable real to sim evaluations for generalist robot policies real to sim reconstruction simulation co training zero shot evaluation arhan jain 1 mingtong zhang 2 kanav arora 1 william chen 3 marcel torne 4 muhammad zubair irshad 5 sergey zakharov 5 yue wang 6 sergey levine 3 8 chelsea finn 4 8 wei chiu ma 7 dhruv shah 2 abhishek gupta 1 5 karl pertsch 3 4 8 equal contribution equal advising 1 university of washington 2 princeton university 3 university of california berkeley 4 stanford university 5 toyota research institute 6 university of southern california 7 cornell university 8 physical intelligence read the paper code polaris is a real to sim approach for constructing high fidelity simulated environments for scalable evaluation polaris s 3d gaussian splatting based framework quickly turns a short video of a real world scene into a simulation environment we use polaris to create a diverse suite of simulated environments and demonstrate strong correlations to real world evaluations for generalist robot policies the polaris pipeline from video to eval step 1 environment scan a 2 5 minute camera scan captures geometry and appearance charuco for metric scale minimal user effort step 2 neural reconstruction 2d gaussian splatting 2dgs recovers photorealistic visuals we extract meshes for collision and contact aware simulation step 3 object robot insertion robots are articulated with kinematics aware splats objects are generated from multiview images trellis and made physics ready interactive reconstruction viewer explore gaussian splat reconstructions and trellis generated object meshes side by side object mesh generation select object electric drill coke cleaner pot scissor spoon showing cleaner object scan object mesh gaussian splat viewer drag and scroll to rotate and zoom select scene workbench stove lobby desk loading viewer gaussian splat viewer not supported on mobile please visit on desktop for the interactive 3d viewer results all performance metrics are based on normalized task progress scores with 20 rollouts in real and 50 rollouts in sim per policy task pair real sim correlation polaris evaluations correlate strongly with real world performance see comparison rollouts below for polaris and ctrl world roboarena correlation polaris evaluation scores also correlate with policy scores from roboarena this validates that polaris rankings also align with real world human judgments of policy progress and quality learn more about roboarena evaluation videos sample rollouts for the same policies and environments loading videos key insight simulation data co training data mix ablation including simulation data in co training improves correlation co training samples diverse simulated rollouts for visual alignment resources compose environments an interactive tool for composing and configuring polaris simulation environments from reconstructed scenes launch tool polaris hub download our evaluation environments or contribute your own see the contribution guide for more details hugging face bibtex reference misc jain2025polarisscalablerealtosimevaluations title polaris scalable real to sim evaluations for generalist robot policies author arhan jain and mingtong zhang and kanav arora and william chen and marcel torne and muhammad zubair irshad and sergey zakharov and yue wang and sergey levine and chelsea finn and wei chiu ma and dhruv shah and abhishek gupta and karl pertsch year 2025 eprint 2512 16881 archiveprefix arxiv primaryclass cs ro url https arxiv org abs 2512 16881 polaris team source code is available here
|