Meta tags:
description= Baking Neural Radiance Fields for Real-Time View Synthesis;
Headings (most frequently used words):
real, neural, radiance, time, video, demos, scenes, baking, fields, for, view, synthesis, iccv, 2021, oral, abstract, interactive, viewer, sparse, grids, snerg, related, links, citation, acknowledgements, paper, code, synthetic, rendered, lego, chair, drums, hotdog, ship, mic, ficus, materials, captured, spheres, vase, on, deck, pine, cone, toy, car,
Text of the page (most frequently used words):
and (17), for (10), the (10), real (10), neural (9), time (9), radiance (8), nerf (7), per (5), fields (5), #sparse (5), our (4), from (4), #baking (4), view (4), rendering (4), color (4), along (4), ray (4), grid (4), snerg (4), with (3), synthesis (3), scenes (3), video (3), scene (3), representation (3), keunhong (2), park (2), help (2), viewer (2), peter (2), hedman (2), pratul (2), srinivasan (2), ben (2), mildenhall (2), jonathan (2), barron (2), paul (2), debevec (2), iccv (2), 2021 (2), work (2), diffuse (2), specular (2), into (2), mlp (2), look (2), feature (2), each (2), point (2), composite (2), these (2), space (2), voxel (2), method (2), data (2), structure (2), render (2), rendered (2), demos (2), images (2), are (2), than (2), thank, michael, broxton, their, generous, debugging, ryan, overbeck, last, minute, javascript, many, thanks, john, flynn, dominik, kaeser, ricardo, martin, brualla, hugues, hoppe, janne, kontkanen, utkarsh, sinha, karlsson, mark, matthews, fruitful, discussions, brainstorming, testing, out, website, template, was, borrowed, michaël, gharbi, acknowledgements, article, hedman2021snerg, title, author, journal, year, citation, concurrent, nerfs, kilonerf, plenoctrees, fastnerf, original, computer, graphics, other, uses, related, links, add, components, compute, final, rgb, decode, composited, features, single, pixel, using, tiny, layers, channels, vector, dimensional, sampled, occupied, use, skip, empty, rays, precomputes, stores, bakes, order, grids, toy, car, pine, cone, vase, deck, spheres, captured, materials, ficus, mic, ship, hotdog, drums, chair, lego, synthetic, interactive, volumetric, representations, such, have, emerged, compelling, technique, learning, represent, goal, photorealistic, unobserved, viewpoints, however, computational, requirements, prohibitive, applications, views, trained, requires, querying, multilayer, perceptron, hundreds, times, present, train, then, precompute, store, bake, novel, called, that, enables, commodity, hardware, achieve, this, introduce, reformulation, architecture, learned, vectors, resulting, retains, ability, fine, geometric, details, dependent, appearance, compact, averaging, less, can, higher, frames, second, laptop, gpu, actual, screen, captures, shown, abstract, code, paper, google, research, oral,
Text of the page (random words):
baking neural radiance fields for real time view synthesis baking neural radiance fields for real time view synthesis iccv 2021 oral peter hedman pratul p srinivasan ben mildenhall jonathan t barron paul debevec google research paper video demos code abstract neural volumetric representations such as neural radiance fields nerf have emerged as a compelling technique for learning to represent 3d scenes from images with the goal of rendering photorealistic images of the scene from unobserved viewpoints however nerf s computational requirements are prohibitive for real time applications rendering views from a trained nerf requires querying a multilayer perceptron mlp hundreds of times per ray we present a method to train a nerf then precompute and store i e bake it as a novel representation called a sparse neural radiance grid snerg that enables real time rendering on commodity hardware to achieve this we introduce 1 a reformulation of nerf s architecture and 2 a sparse voxel grid representation with learned feature vectors the resulting scene representation retains nerf s ability to render fine geometric details and view dependent appearance is compact averaging less than 90 mb per scene and can be rendered in real time higher than 30 frames per second on a laptop gpu actual screen captures are shown in our video video real time interactive viewer demos synthetic rendered scenes lego chair drums hotdog ship mic ficus materials real captured scenes spheres vase on deck pine cone toy car sparse neural radiance grids snerg our method precomputes and stores bakes a nerf into a sparse neural radiance grid snerg data structure in order to render our snerg data structure in real time we use a sparse voxel grid to skip empty space along rays look up a diffuse color for each point sampled along a ray in occupied space and composite these along the ray look up a feature vector 4 dimensional for each point and composite these along the ray decode the composited features into a single specular color per pixel using a tiny 2 layers 16 channels mlp add the diffuse and specular color components to compute the final rgb color related links other uses of baking in computer graphics the original work on neural radiance fields concurrent work on real time rendering of nerfs fastnerf plenoctrees and kilonerf citation article hedman2021snerg title baking neural radiance fields for real time view synthesis author peter hedman and pratul p srinivasan and ben mildenhall and jonathan t barron and paul debevec journal iccv year 2021 acknowledgements we thank keunhong park and michael broxton for their generous help with debugging and ryan overbeck for last minute javascript help many thanks to john flynn dominik kaeser keunhong park ricardo martin brualla hugues hoppe janne kontkanen utkarsh sinha per karlsson and mark matthews for fruitful discussions brainstorming and testing out our viewer the website template was borrowed from michaël gharbi
|
