Meta tags:
Headings (most frequently used words):
-
Text of the page (most frequently used words):
the (37), and (24), imaging (18), with (18), antipa (16), single (13), system (13), for (13), computational (12), sensor (11), nick (10), using (10), our (10), authors (10), image (9), field (9), diffuser (9), from (9), paper (9), this (9), light (8), optics (8), video (8), shot (7), arxiv (7), shutter (7), chinmay (7), that (6), reconstruction (6), can (6), high (6), work (6), talegaonkar (6), nicholas (6), capture (5), information (5), iccp (5), dimensional (5), lensless (5), volumetric (5), more (5), optical (5), diffusercam (5), project (5), rolling (5), accepted (5), data (4), encoding (4), wave (4), such (4), methods (4), laura (4), waller (4), ren (4), compressed (4), sensing (4), than (4), pixels (4), resolution (4), range (4), off (4), via (4), sparse (4), snapshot (4), conventional (4), signals (4), xiang (4), estimation (4), yash (4), belhe (4), ucsd (4), into (3), phase (3), theory (3), best (3), photography (3), compact (3), camera (3), pseudorandom (3), which (3), scene (3), new (3), systems (3), compressive (3), out (3), frame (3), recovery (3), micron (3), where (3), fluorescence (3), has (3), phd (3), please (3), page (3), dai (3), jerry (3), yan (3), pose (3), ravi (3), ramamoorthi (3), 2025 (3), preprint (3), lab (3), edu (3), 2020 (2), all (2), spatio (2), angular (2), 2016 (2), caustic (2), pattern (2), through (2), design (2), model (2), sparsity (2), inverse (2), demonstrate (2), prototype (2), encoded (2), ieee (2), international (2), conference (2), build (2), point (2), projects (2), simple (2), calibration (2), scheme (2), solve (2), enable (2), sample (2), voxels (2), resulting (2), because (2), optica (2), emrah (2), bostan (2), grace (2), kuo (2), exposure (2), 2019 (2), have (2), read (2), trade (2), rate (2), multiplexing (2), about (2), are (2), frames (2), second (2), diffusers (2), global (2), objects (2), cleared (2), mouse (2), brain (2), neurons (2), expressing (2), gfp (2), inexpensive (2), volumes (2), axial (2), applications (2), below (2), time (2), far (2), nature (2), microscopy (2), interested (2), sensors (2), not (2), inspired (2), spent (2), element (2), capable (2), when (2), optimization (2), measurement (2), jessica (2), wang (2), learning (2), dynamic (2), privacy (2), preserving (2), jiacheng (2), cheng (2), nuno (2), vasconcelos (2), pdf (2), 2024 (2), presented (2), deep (2), models (2), eric (2), terrill (2), sophia (2), merrifield (2), nikhil (2), gandudi (2), suresh (2), zachary (2), novack (2), priyanka (2), nagasamudra (2), repurposing (2), marigold (2), zero (2), metric (2), depth (2), defocus (2), blur (2), cues (2), hdr (2), joint (2), gal (2), mishne (2), been (2), iccv (2), tzu (2), mao (2), differentiable (2), end (2), working (2), national (2), engineering (2), nantipa (2), website (2), copyright, rights, reserved, refocusable, speckle, coherent, retrieval, method, calibrate, measuring, surface, height, focus, images, further, informs, geometry, purely, additive, ray, valid, done, constrained, iterative, present, empirical, results, refocusing, sylvia, necula, 2018, easy, three, consists, solely, placed, front, every, within, view, unique, caustics, physical, approximation, large, scale, problem, computationally, efficient, way, patterns, exploits, grid, chosen, match, experimentally, measured, two, 100, million, being, reconstructed, megapixel, however, effective, varies, significantly, content, effect, common, wide, cameras, provide, analyzing, demo, 2017, top, cited, articles, jan, reinhard, heckel, ben, mildenhall, demonstrates, innate, properties, chips, finite, bandwidth, recording, typically, requires, between, pixel, count, techniques, circumvent, assuming, compressible, here, propose, spatially, compress, enabling, whole, sampled, row, quickly, cmos, conveniently, achieved, based, able, recover, 140, over, 500, per, captured, proof, concept, uses, easily, fabricated, paired, shelf, enables, exceeds, sampling, limited, performance, equivalent, sufficiently, patrick, oare, code, stills, showing, individual, neuron, cell, bodies, dendrites, 900x700x300, wxhxd, raw, combines, replacing, tube, lens, engineered, prototyped, multiphoton, polymerization, result, fluorescent, lateral, rates, moving, parts, well, suited, needed, could, parallel, incubators, space, issue, head, mounting, vivo, neuroscience, videos, show, capability, first, series, stained, tardigrade, waterbear, acquired, tissue, achieves, greater, approaches, miniscope, now, science, open, access, miniscope3d, optimized, miniature, recent, broadly, just, jointly, designing, algorithms, aim, discover, novel, modalities, possible, lenses, alone, most, focused, researching, added, focal, plane, allowing, additionally, shown, coauthored, simultaneously, act, encoder, architecture, recovered, samples, see, including, tutorial, raspberry, put, together, camille, biscarrat, shreyas, parthasarathy, your, own, encodes, research, interests, ultra, low, cost, mechanical, smartphone, attachment, blood, pressure, yinan, xuan, colin, barry, souza, wen, alison, moore, edward, collab, scientific, reports, 2023, robust, inversion, attacks, jia, wan, eccv, oral, barrel, oceans, hallifax, buried, sea, vision, volumetrically, consistent, gaussian, rasterization, cvpr, highlight, leveraging, 6dof, foundation, mapping, marine, sediment, burial, functions, randomization, kyrollos, yanny, kristina, monakhova, tog, will, siggraph, 2026, rngcam, speed, measurements, kevin, tandi, coming, soon, chi, jui, steve, rotenberg, spotlight, neurips, news, received, berkeley, eecs, study, prior, years, metrology, ignition, facility, lawrence, livermore, like, hiking, playing, trumpet, assistant, professor, san, diego, jacobs, school, department, electrical, computer, you, neuroimaging, ocean, anything, else, related, feel, free, email, visit, google, scholar,
Text of the page (random words):
nick antipa nick antipa nantipa ucsd edu lab website cv google scholar i am an assistant professor in at the uc san diego jacobs school of engineering in the department of electrical and computer engineering if you are interested in computational imaging computational photography neuroimaging ocean microscopy or anything else related please feel free to email me at nantipa ucsd edu for more information please visit the ucsd lab website computational imaging ucsd edu about me i received my phd from uc berkeley eecs where i study computational imaging with laura waller and ren ng prior to my phd work i spent 5 years working on optical metrology for the national ignition facility at lawrence livermore national lab when i m not working i like hiking and playing the trumpet news our paper is accepted as a spotlight to neurips repurposing marigold for zero shot metric depth estimation via defocus blur cues authors chinmay talegaonkar nikhil gandudi suresh zachary novack yash belhe priyanka nagasamudra nicholas antipa project page arxiv our joint work with ravi ramamoorthi and tzu mao li on differentiable wave optics has been accepted to iccv 2025 a differentiable wave optics model for end to end computational imaging system optimization authors chi jui ho yash belhe steve rotenberg ravi ramamoorthi tzu mao li nicholas antipa arxiv our joint project with gal mishne has been accepted to iccv 2025 rngcam high speed video from rolling and global shutter measurements authors kevin tandi xiang dai chinmay talegaonkar gal mishne nicholas antipa preprint coming soon xiang s hdr paper is accepted to tog this work will be presented at siggraph 2026 single shot hdr using conventional image sensor shutter functions and optical randomization authors xiang dai kyrollos yanny kristina monakhova nicholas antipa new preprint leveraging 6dof pose foundation models for mapping marine sediment burial authors jerry yan chinmay talegaonkar nick antipa eric terrill sophia merrifield arxiv new preprint repurposing marigold for zero shot metric depth estimation via defocus blur cues authors chinmay talegaonkar nikhil gandudi suresh zachary novack yash belhe priyanka nagasamudra nicholas antipa arxiv chinmay s paper volumetrically consistent 3d gaussian rasterization is accepted to cvpr 2025 highlight authors chinmay talegaonkar yash belhe ravi ramamoorthi and nicholas antipa arxiv paper project page jerry yan s work on barrel pose estimation is presented at oceans hallifax 2024 pose estimation of buried deep sea objects using 3d vision deep learning models authors jerry yan chinmay talegaonkar nick antipa eric terrill sophia merrifield pdf our paper with nuno vasconcelos and jiacheng cheng on dynamic privacy preserving imaging is in eccv 2024 oral learning a dynamic privacy preserving camera robust to inversion attacks authors jiacheng cheng xiang dai jia wan nick antipa nuno vasconcelos paper pdf our collab with ed wang is out in nature scientific reports 2023 ultra low cost mechanical smartphone attachment for no calibration blood pressure measurement authors yinan xuan colin barry jessica de souza jessica h wen nick antipa alison a moore and edward j wang research interests i am broadly interested in design of computational imaging systems that capture more than just 2d by jointly designing optics sensors and algorithms i aim to discover novel imaging systems that enable modalities not possible with conventional lenses and sensors alone most of my work has focused on single shot capture of high dimensional optical signals inspired by compressed sensing i have spent my phd time researching pseudorandom phase optics i e diffusers as a computational imaging element capable of snapshot capture of high dimensional optical signals when added to the focal plane of a conventional camera a diffuser encodes 4d light field information allowing recovery via optimization methods additionally as shown in our work on the diffusercam coauthored with grace kuo the diffuser can simultaneously act as the imaging element and the high dimensional encoder this lensless architecture is capable of encoding 3d signals such as volumetric and video data into a single snapshot measurement using sparse recovery methods inspired by compressed sensing sparse high dimensional signals can be recovered with far more samples than sensor pixels please see the diffusercam project page for more information including a tutorial to build your own using a raspberry pi put together by shreyas parthasarathy and camille biscarrat recent projects miniscope3d optimized single shot miniature 3d fluorescence microscopy the paper is now out in nature light science and applications open access this system combines the pseudorandom encoding scheme of diffusercam with the miniscope replacing the tube lens with an engineered diffuser prototyped using multiphoton polymerization the result is an inexpensive compressive imaging system that can capture fluorescent volumes with 3 micron lateral resolution and 10 micron axial at video rates with no moving parts this compact system is well suited to a range of applications where inexpensive compact volumetric fluorescence imaging is needed this could range from parallel imaging in incubators where space is an issue to head mounting for volumetric in vivo neuroscience the videos below show the snapshot 3d reconstruction capability of this system the first is a time series of a fluorescence stained tardigrade waterbear acquired at 30 volumes second below that is a snapshot reconstruction of neurons expressing gfp in cleared mouse brain tissue our system achieves a far greater axial imaging range than conventional light field approaches single frame raw data cleared mouse brain neurons expressing gfp volumetric reconstruction showing individual neuron cell bodies and dendrites 900x700x300 micron wxhxd video from stills lensless imaging with rolling shutter arxiv code and sample data nick antipa patrick oare emrah bostan ren ng laura waller ieee international conference on computational photography iccp 2019 best paper at iccp 2019 this project demonstrates the innate compressive video properties of diffusercam because image sensor chips have a finite bandwidth with which to read out pixels recording video typically requires a trade off between frame rate and pixel count compressed sensing techniques can circumvent this trade off by assuming that the image is compressible here we propose using multiplexing optics to spatially compress the scene enabling information about the whole scene to be sampled from a row of sensor pixels which can be read off quickly via a rolling shutter cmos sensor conveniently such multiplexing can be achieved with a simple lensless diffuser based imaging system using sparse recovery methods we are able to recover 140 video frames at over 4 500 frames per second all from a single captured image with a rolling shutter sensor our proof of concept system uses easily fabricated diffusers paired with an off the shelf sensor the resulting prototype enables compressive encoding of high frame rate video into a single rolling shutter exposure and exceeds the sampling limited performance of an equivalent global shutter system for sufficiently sparse objects diffusercam lensless single exposure 3d imaging arxiv nick antipa grace kuo reinhard heckel ben mildenhall emrah bostan ren ng laura waller optica 2018 no 2 in optica 15 top cited articles jan 2020 best demo iccp 2017 we demonstrate a compact easy to build computational camera for single shot three dimensional 3d imaging our lensless system consists solely of a diffuser placed in front of an image sensor every point within the volumetric field of view projects a unique pseudorandom pattern of caustics on the sensor by using a physical approximation and simple calibration scheme we solve the large scale inverse problem in a computationally efficient way the caustic patterns enable compressed sensing which exploits sparsity in the sample to solve for more 3d voxels than pixels on the 2d sensor our 3d reconstruction grid is chosen to match the experimentally measured two point optical resolution resulting in 100 million voxels being reconstructed from a single 1 3 megapixel image however the effective resolution varies significantly with scene content because this effect is common to a wide range of computational cameras we provide a new theory for analyzing resolution in such systems single shot diffuser encoded light field imaging nick antipa sylvia necula ren ng laura waller ieee international conference on computational photography iccp 2016 best paper at iccp 2016 we capture 4d light field data in a single 2d sensor image by encoding spatio angular information into a speckle field caustic pattern through a phase diffuser using wave optics theory and a coherent phase retrieval method we calibrate the system by measuring the diffuser surface height from through focus images wave optics theory further informs the design of system geometry such that a purely additive ray optics model is valid light field reconstruction is done using sparsity constrained iterative inverse methods we demonstrate a prototype system and present empirical results of 4d light field reconstruction and computational refocusing from a single diffuser encoded 2d image refocusable 4d light field spatio angular image copyright 2020 nick antipa all rights reserved
|