Meta tags:

Headings (most frequently used words):

text, single, sketch, image, hand, motions, video, crafted, input, depth, style, mask, output, drawings, videocomposer, masked, videos, compositional, synthesis, with, motion, controllability, more, controllable, technology, for, content, creation,

Text of the page (most frequently used words):
text (35), and (27), the (27), video (23), single (20), #sketch (17), with (16), image (16), hand (15), #motions (14), you (13), crafted (12), for (11), beautiful (10), ability (10), depth (9), woman (9), input (9), compositional (8), style (8), temporal (8), will (7), golden (6), moving (6), mask (6), motion (5), moon (5), videos (5), synthesis (5), yellow (4), give (4), generation (4), sea (4), girl (4), output (4), view (4), that (4), videocomposer (4), conditions (4), alibaba (3), group (3), are (3), your (3), more (3), into (3), sequence (3), can (3), tiger (3), walking (3), control (3), red (3), backed (3), shrike (3), lanius (3), collurio (3), drawings (3), looking (3), camera (3), office (3), coastal (3), cleveland (3), road (3), robin (3), hood (3), bay (3), blue (3), sky (3), white (3), clouds (3), swan (3), lazily (3), drifting (3), trimming (3), itself (3), calm (3), river (3), smiling (3), cowboy (3), hat (3), wheat (3), ears (3), spatial (3), team (2), large (2), then (2), have (2), yingya (2), water (2), daffodils (2), open (2), their (2), blossoms (2), simple (2), most (2), designer (2), making (2), pattern (2), new (2), dress (2), holding (2), christmas (2), lights (2), dare (2), imagine (2), transfer (2), want (2), better (2), tell (2), even (2), beauty (2), life (2), pigeon (2), sits (2), stone (2), iron (2), net (2), behind (2), within (2), masked (2), aerial (2), track (2), over (2), bosphorus (2), istanbul (2), matterhorn (2), flowers (2), foreground (2), bouquet (2), leaves (2), autumn (2), city (2), park (2), flexibly (2), models (2), code (2), controllability (2), higher (2), content (2), creation (2), controllable (2), dynamics (2), frame (2), consistency (2), videocompoer (2), encoder (2), zhang (2), wang (2), copyright, authors, fvi, seeking, exhilarating, challenge, chance, collaborate, aigc, scale, pretraining, come, right, place, searching, talented, motivated, imaginative, researchers, join, our, interested, please, don, hesitate, send, resume, via, email, zyy, inc, com, ripe, cherry, tomatoes, fall, bowl, slow, fun, horse, animation, some, sketches, turn, them, moments, poured, beer, mug, lighthouse, near, luxury, expensive, table, serving, romantic, dinner, candles, also, seemingly, nothing, impossible, act, become, way, just, nutshell, translation, create, one, five, pointed, star, box, grassland, how, moves, strokes, bring, versatile, using, little, hint, showcase, heart, black, broken, time, restore, its, moment, inpainting, honey, bee, collecting, pollen, blooming, sunflower, picture, describe, vivid, living, world, rotation, long, haired, standing, forest, generate, any, real, source, art, imagination, solution, bringing, overview, summary, generated, paper, pursuit, standard, visual, has, yielded, remarkable, progress, customizable, however, achieving, remains, challenging, due, variation, requirement, cross, based, paradigm, this, work, presents, allows, users, compose, textual, importantly, specifically, considering, characteristic, data, introduce, vector, from, compressed, explicit, signal, provide, guidance, regarding, addition, develop, spatio, condition, stc, serves, unified, interface, effectively, incorporate, relations, sequential, inputs, which, model, could, make, use, hence, achieve, inter, extensive, experimental, results, suggest, able, patterns, simultaneously, synthesized, various, forms, such, description, reference, simply, made, publicly, available, ant, jingren, zhou, deli, zhao, yujun, shen, jiuniu, dayou, chen, shiwei, hangjie, yuan, xiang, technology,

Text of the page (random words):
videocomposer videocomposer controllable technology for video content creation videocomposer compositional video synthesis with motion controllability xiang wang 1 hangjie yuan 1 shiwei zhang 1 dayou chen 1 jiuniu wang 1 yingya zhang 1 yujun shen 2 deli zhao 1 jingren zhou 1 1 alibaba group 2 ant group the pursuit of controllability as a higher standard of visual content creation has yielded remarkable progress in customizable image synthesis however achieving controllable video synthesis remains challenging due to the large variation of temporal dynamics and the requirement of cross frame temporal consistency based on the paradigm of compositional generation this work presents videocompoer that allows users to flexibly compose a video with textual conditions spatial conditions and more importantly temporal conditions specifically considering the characteristic of video data we introduce the motion vector from compressed videos as an explicit control signal to provide guidance regarding temporal dynamics in addition we develop a spatio temporal condition encoder stc encoder that serves as a unified interface to effectively incorporate the spatial and temporal relations of sequential inputs with which the model could make better use of temporal conditions and hence achieve higher inter frame consistency extensive experimental results suggest that videocompoer is able to control the spatial and temporal patterns simultaneously within a synthesized video in various forms such as text description sketch sequence reference video or even simply hand crafted motions code and models will be made publicly available paper code models overview summary of the generated videos the real source of art is your imagination and videocomposer is the solution for bringing it to life ability 1 compositional video synthesis you can generate videos flexibly in any style that you can imagine text sketch rotation view of a beautiful long haired woman standing in the forest image depth style depth sketch motions style hand crafted sketch hand crafted motions a moving golden moon ability 2 compositional image to video synthesis give me a picture and i will describe a beautiful vivid and living world for you text single image tiger text single image motions tiger text single image smiling woman in cowboy hat with wheat ears text single image motions smiling woman in cowboy hat with wheat ears text single image bouquet of the yellow leaves autumn girl walking in city park text single image depth bouquet of the yellow leaves autumn girl walking in city park text single image smiling woman in cowboy hat with wheat ears text single image depth honey bee collecting pollen on a blooming sunflower text single image the matterhorn with flowers in the foreground text single image sketch the matterhorn with flowers in the foreground text single image aerial ha track over bosphorus in istanbul text single image depth aerial ha track over bosphorus in istanbul ability 3 compositional video inpainting give me a broken time and i will restore it to its most beautiful moment for you input masked videos text mask swan lazily drifting and trimming itself on a calm river text mask depth swan lazily drifting and trimming itself on a calm river text mask sketch black swan lazily drifting and trimming itself on a calm river input masked videos text mask coastal view of cleveland road and robin hood s bay blue sky and sea with white clouds text mask depth coastal view of cleveland road and robin hood s bay blue sky and sea with white clouds text mask sketch coastal view of cleveland road and robin hood s bay blue sky and sea with white clouds ability 4 compositional sketch to video generation give me a little hint and i will showcase the beauty within your heart input hand drawings text single sketch pigeon sits on a stone with an iron net behind it text single sketch depth pigeon sits on a stone with an iron net behind it input hand drawings text single sketch a beautiful woman looking at camera in office text single sketch style a beautiful woman looking at camera in office text single sketch style a beautiful woman looking at camera in office input hand drawings text single sketch red backed shrike lanius collurio text single sketch style red backed shrike lanius collurio text single sketch style red backed shrike lanius collurio ability 5 versatile motion control using hand crafted motions tell me how beauty moves with simple strokes and i will bring it to life for you text hand crafted motions a moving golden moon text hand crafted motions a moving golden moon text hand crafted motions a moving golden moon text hand crafted motions a moving golden moon text hand crafted motions a tiger walking on the grassland text hand crafted motions a moving box image hand crafted motions text hand crafted motions a golden five pointed star ability 6 motion transfer if it is beautiful i will create an even more beautiful one for you ability 7 video translation if you want it to be better and become the way you want it to be just tell me in a nutshell input video output video input video output video input video output video input video output video ability 8 video style transfer seemingly nothing is impossible if you dare to imagine and dare to act ability 9 compositional sketch sequence to video generation if it is beautiful then we can also have it girl holding christmas lights girl holding christmas lights woman designer making pattern for new dress woman designer making pattern for new dress luxury expensive table serving for a romantic dinner with candles a lighthouse is near the sea water is poured into the beer mug ability 10 compositional depth sequence to video generation give me some simple sketches and i will turn them into the most beautiful moments for you yellow daffodils open up their blossoms yellow daffodils open up their blossoms fun horse 3d animation ripe cherry tomatoes fall into a bowl of water slow motion more if you are seeking an exhilarating challenge and the chance to collaborate with aigc and large scale pretraining then you have come to the right place we are searching for talented motivated and imaginative researchers to join our team if you are interested please don t hesitate to send us your resume via email yingya zyy alibaba inc com copyright alibaba group authors fvi team