Meta tags:
description=GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation;

Headings (most frequently used words):

gpt, 4v, 3d, different, levels, ision, is, human, aligned, evaluator, for, text, to, generation, cvpr, 2024, abstract, motivation, or, other, mllms, can, understand, content, via, multi, view, images, as, input, prompt, distribution, complexity, creativity, method, overview, examples, bibtex,

Text of the page (most frequently used words):
and (31), with (14), gpt (12), for (10), human (7), text (7), the (7), aligned (6), #different (6), evaluation (6), this (5), criteria (4), input (4), prompts (4), these (4), prompt (4), more (4), models (4), template (3), ision (3), evaluator (3), generation (3), create (3), levels (3), complexity (3), generator (3), can (3), metrics (3), user (3), results (3), university (3), tong (2), guandao (2), yang (2), zhibing (2), kai (2), zhang (2), ziwei (2), liu (2), leonidas (2), guibas (2), dahua (2), lin (2), gordon (2), wetzstein (2), cvpr (2), 2024 (2), that (2), comparison (2), two (2), assets (2), images (2), final (2), its (2), finally (2), method (2), mechanical (2), creativity (2), symmetrical (2), smooth (2), multi (2), lifelike (2), flowers (2), full (2), setting (2), our (2), detailed (2), plant (2), primarily (2), appearing (2), showcasing (2), accentuated (2), crafted (2), mainly (2), from (2), natural (2), accented (2), intended (2), static (2), exhibiting (2), set (2), atmosphere (2), caption (2), steampunk (2), design (2), generative (2), well (2), align (2), preference (2), studies (2), paper (2), metric (2), compare (2), thank, providing, amazing, project, nerfies, inproceedings, wu2023gpteval3d, author, title, booktitle, year, bibtex, examples, customizable, instruction, contains, necessary, information, conduct, tasks, complete, random, seeds, aware, will, then, consume, inputs, output, assessments, assemble, answers, robust, estimate, task, overview, frog, translucent, skin, displaying, heart, beating, dancing, elephant, orange, monarch, butterfly, resting, dandelion, solid, stone, fountain, water, cascading, over, edges, into, clear, circular, pond, surrounded, blooming, lilies, center, sunlit, courtyard, large, layered, wedding, cake, fondant, delicate, piping, sugar, bloom, displayed, silver, stand, sleeping, cat, controllable, creative, often, lead, challenging, produce, various, allows, examine, textto, performance, cases, efficiently, distribution, potted, rugged, terrain, organic, naturalistic, structure, vibrant, green, yellow, accompanied, smaller, pink, blossoms, scattering, pebbles, rocks, digital, textures, mimicking, materials, subtle, shading, environmental, visualization, contemporary, aesthetic, outdoor, like, serene, peaceful, intricately, apparatus, nature, three, dimensional, worn, metallic, glassy, texture, central, clock, face, multiple, gauges, pipes, gears, levers, aged, bronze, glass, wood, time, display, possible, atmospheric, measurements, victorian, style, industrial, workshop, environment, nostalgic, inventive, mood, other, mllms, understand, content, via, view, motivation, despite, recent, advances, methods, there, notable, absence, reliable, existing, usually, focus, single, criterion, each, such, how, asset, lack, flexibility, generalize, might, not, preferences, conducting, alternative, offers, both, adaptability, however, very, expensive, scale, presents, automatic, versatile, end, first, develop, using, generate, evaluating, which, serve, further, instructing, according, defined, use, pairwise, assign, elo, ratings, experimental, suggest, strongly, across, abstract, data, code, shanghai, artificial, intelligence, laboratory, lab, nanyang, technological, adobe, research, stanford, chinese, hong, kong, equal, contribution,

Text of the page (random words):
gpt 4v ision is a human aligned evaluator for text to 3d generation gpt 4v ision is a human aligned evaluator for text to 3d generation cvpr 2024 tong wu 1 5 guandao yang 2 zhibing li 1 5 kai zhang 3 ziwei liu 4 leonidas guibas 2 dahua lin 1 5 gordon wetzstein 2 equal contribution 1 the chinese university of hong kong 2 stanford university 3 adobe research 4 s lab nanyang technological university 5 shanghai artificial intelligence laboratory paper code data abstract despite recent advances in text to 3d generative methods there is a notable absence of reliable evaluation metrics existing metrics usually focus on a single criterion each such as how well the asset aligned with the input text these metrics lack the flexibility to generalize to different evaluation criteria and might not align well with human preferences conducting user preference studies is an alternative that offers both adaptability and human aligned results user studies however can be very expensive to scale this paper presents an automatic versatile and human aligned evaluation metric for text to 3d generative models to this end we first develop a prompt generator using gpt 4v to generate evaluating prompts which serve as input to compare text to 3d models we further design a method instructing gpt 4v to compare two 3d assets according to user defined criteria finally we use these pairwise comparison results to assign these models elo ratings experimental results suggest our metric strongly align with human preference across different evaluation criteria motivation gpt 4v or other mllms can understand 3d content via multi view images as input gpt 4v caption intricately detailed steampunk apparatus primarily of mechanical design nature appearing three dimensional with worn metallic and glassy texture showcasing a central clock face and multiple gauges and accentuated by pipes gears and levers crafted mainly from aged bronze and accented with glass and wood intended for time display and possible atmospheric measurements and is static exhibiting a victorian steampunk style set in an industrial workshop environment with a nostalgic and inventive mood atmosphere gpt 4v caption detailed potted plant on a rugged terrain primarily of organic and naturalistic structure appearing full and lifelike showcasing a vibrant green plant with yellow flowers and accompanied by smaller pink blossoms and accentuated by a scattering of pebbles and rocks crafted mainly from digital textures mimicking natural materials and accented with subtle shading intended for environmental visualization and is static exhibiting a contemporary and natural aesthetic set in an outdoor like setting with a serene and peaceful atmosphere prompt distribution controllable prompt generator more complexity or more creative prompts often lead to a more challenging evaluation setting our prompt generator can produce prompts with various levels of creativity and complexity this allows us to examine textto 3d models performance in different cases more efficiently different complexity levels a sleeping cat a large multi layered symmetrical wedding cake with smooth fondant delicate piping and lifelike sugar flowers in full bloom displayed on a silver stand a solid symmetrical smooth stone fountain with water cascading over its edges into a clear circular pond surrounded by blooming lilies in the center of a sunlit courtyard different creativity levels orange monarch butterfly resting on a dandelion a dancing elephant frog with a translucent skin displaying a mechanical heart beating method overview we create a customizable instruction template that contains necessary information for gpt 4v to conduct comparison tasks for two 3d assets we complete this template with different evaluation criteria input 3d images and random seeds to create the final 3d aware prompts for gpt 4v gpt 4v will then consume these inputs to output its assessments finally we assemble gpt 4v s answers to create a robust final estimate of the task examples bibtex inproceedings wu2023gpteval3d author tong wu and guandao yang and zhibing li and kai zhang and ziwei liu and leonidas guibas and dahua lin and gordon wetzstein title gpt 4v ision is a human aligned evaluator for text to 3d generation booktitle cvpr year 2024 we thank nerfies for providing this amazing project template