Meta tags:
description=Dual-Camera Defocus Control by Learning to Refocus;
keywords=defocus-control, dual-camera, computational photography;

Headings (most frequently used words):

defocus, control, input, output, drbnet, ours, effect, dc2, dual, camera, by, learning, to, refocus, cvpr, 2023, demo, video, abstract, how, did, we, build, it, comparison, with, baselines, creative, applications, bibtex, deblurring, refocusing, deblur, blur, bokehme, tilt, shift, split, focus, content, driven,

Text of the page (most frequently used words):
the (45), and (36), defocus (27), #control (19), input (17), #refocus (15), camera (14), can (14), with (14), dof (12), for (10), map (9), our (8), image (8), this (7), dual (7), target (7), used (7), example (7), focus (7), that (6), from (5), method (5), simply (5), model (5), here (5), depth (5), field (5), aperture (5), capture (5), learning (4), yang (4), arbitrary (4), you (4), effect (4), but (4), view (4), different (4), photo (4), ground (4), truth (4), using (4), resolution (4), creative (3), source (3), each (3), hardware (3), below (3), all (3), blur (3), output (3), tilt (3), shift (3), deblurring (3), dataset (3), smartphone (3), time (3), perform (3), how (3), cameras (3), captured (3), wide (3), system (3), real (3), world (3), video (3), website (2), dc2 (2), alzayer (2), hadi (2), abuolaim (2), abdullah (2), chun (2), chan (2), leung (2), chen (2), lou (2), ying (2), huang (2), jia (2), bin (2), kar (2), abhishek (2), 2023 (2), have (2), realistic (2), show (2), examples (2), maps (2), lens (2), simulate (2), setting (2), two (2), requires (2), work (2), software (2), set (2), half (2), focused (2), woman (2), content (2), split (2), ours (2), deblur (2), drbnet (2), refocusing (2), same (2), based (2), also (2), use (2), train (2), pixel (2), proxy (2), task (2), quality (2), fixed (2), key (2), apertures (2), ultra (2), effects (2), demonstrate (2), where (2), post (2), including (2), demo (2), single (2), which (2), has (2), high (2), inputs (2), frame (2), more (2), great, template, was, borrowed, nerfies, licensed, under, commons, attribution, sharealike, international, license, inproceedings, alzayer2023defocuscontrol, title, author, booktitle, proceedings, ieee, cvf, conference, computer, vision, pattern, recognition, pages, year, bibtex, allows, providing, desired, does, not, physically, wild, your, imaginations, some, thought, include, produce, miniature, like, done, tilting, respect, sensor, correspond, very, narrow, top, black, cinematic, movies, emphasize, subjects, distances, often, custom, make, left, right, man, reduced, emphasis, compare, generate, choose, highlight, dog, them, out, everything, else, segmentation, mask, created, driven, applications, bokehme, comparison, baselines, collect, photos, variable, fields, due, fix, since, blurring, regions, means, least, hard, observation, hypothesize, trained, learn, collected, 100, stacks, detail, fusion, network, dfnet, giving, value, proportional, blurry, then, after, training, maniuplating, test, did, build, today, are, increasingly, approaching, versatility, professional, through, combination, advancements, however, remains, limitation, preventing, users, controlling, images, many, smartphones, now, multiple, specifically, wider, deeper, higher, primary, shallower, propose, synthetically, varying, distance, fusing, information, such, insight, leverage, quantitative, qualitative, evaluations, data, efficacy, outperform, state, art, bokeh, rendering, finally, enabled, abstract, interactive, above, main, called, shallow, deep, lower, combine, get, controllable, while, maintaining, slider, subject, click, loading, simulating, interactively, change, see, given, both, add, enable, complete, showcase, changing, focal, plane, first, please, full, screen, highest, arxiv, paper, cvpr, google, university, maryland, ual, amera, efocus, ontrol, autophoto, research,

Text of the page (random words):
dc2 dual camera defocus control by learning to refocus more research autophoto dc 2 d ual c amera d efocus c ontrol by learning to refocus hadi alzayer abdullah abuolaim leung chun chan yang yang ying chen lou jia bin huang abhishek kar university of maryland google cvpr 2023 paper arxiv video given a dual camera capture we can both deblur and add realistic blur to enable complete defocus control including refocusing aperture control and more here we showcase examples where we simulate changing the focal plane and aperture and the first frame of each video is the input view please view in full screen for highest quality defocus control demo using a single capture with dual camera we can perform post capture refocus and dof control by simulating different apertures below is the captured frame that is used as an input you can interactively change the refocus and depth of field to see how our method can be used in the real world loading click on a subject to refocus and use the slider for dof control the interactive demo above is using a single capture with dual camera a photo captured with the main camera also called wide w which has high resolution and shallow depth of field dof and a photo from the ultra wide camera uw which has a deep dof but lower resolution our method can combine the two inputs to get a controllable dof while maintaining high resolution below we show the inputs for this example w input uw input video abstract smartphone cameras today are increasingly approaching the versatility and quality of professional cameras through a combination of hardware and software advancements however fixed aperture remains a key limitation preventing users from controlling the depth of field dof of captured images at the same time many smartphones now have multiple cameras with different fixed apertures specifically an ultra wide camera with wider field of view and deeper dof and a higher resolution primary camera with shallower dof in this work we propose dc 2 a system for defocus control for synthetically varying camera aperture focus distance and arbitrary defocus effects by fusing information from such a dual camera system our key insight is to leverage real world smartphone camera dataset by using image refocus as a proxy task for learning to control defocus quantitative and qualitative evaluations on real world data demonstrate our system s efficacy where we outperform state of the art on defocus deblurring bokeh rendering and image refocus finally we demonstrate creative post capture defocus control enabled by our method including tilt shift and content based defocus effects how did we build it we can t collect dataset of smartphone photos with variable depth of fields due to the fix aperture but we can refocus since image refocus requires deblurring and blurring different regions of the image at the same time that means that image refocus is at least as hard as dof control based on this observation we hypothesize that a model trained on image refocus can also perform dof control so we use image refocus as a proxy task to learn arbitrary defocus control so to train a model we collected a dataset of 100 focus stacks we train our defocus control model detail fusion network dfnet to refocus using dual camera input by giving it input and target defocus maps the value of each pixel in the defocus map is proportional to how blurry that pixel is then after training the model to refocus we can perform arbitrary defocus control by simply maniuplating the target defocus map at test time comparison with baselines deblurring example 1 example 2 w input uw input ground truth w input uw input ground truth drbnet ours refocusing example 1 example 2 w input uw input ground truth w input uw input ground truth deblur drbnet blur bokehme ours creative applications our method allows for arbitrary defocus control by simply providing the desired defocus map to the model the defocus control does not have to be physically realistic so you can go wild with your imaginations here we show some examples that we thought of and include the source and target defocus maps used for each example tilt shift effect tilt shift can be used to control the depth of field and produce miniature like effect with hardware it is done by tilting the lens with respect to the sensor but here we simulate it by setting the target defocus map to correspond to a very narrow dof at the top of the image below you can view the source defocus map all in focus so all black and target defocus map used for this example input output split focus effect split focus is a cinematic effect used in movies to emphasize and focus on two subjects at different distances from the camera it often requires custom lens to make it work with hardware but we can simply do it in software with our method here we set the left half of the photo to be focused on the woman and the right half is focused on the man and with a reduced dof for emphasis you can compare the source defocus map and target defocus map used to generate this photo input output content driven defocus control here we choose to highlight the woman and dog by simply setting them to be all in focus and blur out everything else we simply set the target defocus map to be the segmentation mask we created input output bibtex inproceedings alzayer2023defocuscontrol title dc2 dual camera defocus control by learning to refocus author alzayer hadi and abuolaim abdullah and chun chan leung and yang yang and chen lou ying and huang jia bin and kar abhishek booktitle proceedings of the ieee cvf conference on computer vision and pattern recognition pages year 2023 this website is licensed under a creative commons attribution sharealike 4 0 international license this great website template was borrowed from nerfies