Meta tags:
Headings (most frequently used words):
learning, self, supervised, contrastive, contents, pseudo, labels, types, comparison, with, other, forms, of, machine, examples, references, further, reading, external, links, autoassociative, non, joint, embedding, and, predictive, architectures,
Text of the page (most frequently used words):
learning (119), the (93), #supervised (57), self (56), and (43), data (32), neural (27), that (25), for (25), model (21), #machine (20), from (18), network (18), doi (18), arxiv (17), with (16), training (16), this (15), edit (15), ieee (14), conference (14), contrastive (14), input (14), are (13), iccv (13), representation (12), used (12), vision (11), deep (11), task (11), computer (10), models (10), s2cid (10), international (10), 2019 (10), using (9), lecun (9), language (9), image (9), artificial (9), latent (9), pseudo (9), examples (9), labels (9), wikipedia (8), text (8), visual (8), yann (8), intelligence (8), embedding (8), proceedings (8), unsupervised (8), 978 (8), isbn (8), 1109 (8), joint (8), can (8), networks (8), example (8), other (8), positive (8), retrieved (7), based (7), systems (7), recognition (7), context (7), images (7), processing (7), predictive (7), semi (7), learn (7), where (7), may (6), non (6), autoencoder (6), architectures (6), speech (6), human (6), loss (6), 2015 (6), 2017 (6), 2021 (6), analysis (6), which (6), not (6), negative (6), classification (6), displaystyle (6), left (6), right (6), search (5), page (5), generative (5), architecture (5), andrew (5), reasoning (5), automated (5), approach (5), gradient (5), reinforcement (5), method (5), regression (5), 2018 (5), pmid (5), issn (5), doersch (5), carl (5), october (5), 2023 (5), 2020 (5), june (5), representations (5), jepa (5), noise (5), estimation (5), random (5), autoassociative (5), machines (5), its (5), ncssl (5), ssl (5), sample (5), pairs (5), contents (4), policy (4), use (4), articles (4), technical (4), july (4), convolutional (4), state (4), term (4), john (4), knowledge (4), large (4), world (4), diffusion (4), autonomous (4), word (4), engineering (4), association (4), computational (4), 2022 (4), wang (4), april (4), micron (4), prediction (4), links (4), bardes (4), adrien (4), own (4), new (4), main (4), shot (4), transfer (4), path (4), statistical (4), facebook (4), concept (4), uses (4), labeled (4), encoder (4), create (4), process (4), output (4), such (4), between (4), types (4), log (4), vector (4), hide (4), move (4), sidebar (4), toggle (3), view (3), about (3), privacy (3), september (3), january (3), too (3), 2025 (3), short (3), wikidata (3), art (3), video (3), recurrent (3), transformer (3), alex (3), fei (3), semantic (3), list (3), audio (3), general (3), agent (3), algorithm (3), symbolic (3), open (3), datasets (3), descent (3), clustering (3), variance (3), history (3), linguistics (3), november (3), methods (3), robust (3), 4673 (3), multi (3), quentin (3), program (3), repair (3), diagnostics (3), 1038 (3), jean (3), emnlp (3), natural (3), supervision (3), few (3), via (3), 2016 (3), cvpr (3), pattern (3), features (3), multimodal (3), reduction (3), 2013 (3), correlation (3), detection (3), drift (3), through (3), humans (3), unlabeled (3), trained (3), instead (3), small (3), learns (3), two (3), only (3), way (3), itself (3), however (3), pretext (3), unlike (3), one (3), requiring (3), does (3), these (3), supervisory (3), signals (3), then (3), autoencoders (3), space (3), rather (3), than (3), has (3), while (3), without (3), would (3), samples (3), function (3), pair (3), when (3), help (3), related (3), field (3), article (3), tools (3), languages (2), table (2), statistics (2), safety (2), contact (2), under (2), terms (2), was (2), last (2), 2026 (2), hidden (2), categories (2), 2024 (2), description (2), different (2), category (2), impact (2), applications (2), principle (2), act (2), gan (2), mamba (2), rnn (2), perceptron (2), gru (2), long (2), lstm (2), turing (2), daniel (2), jan (2), david (2), oriol (2), vinyals (2), yoshua (2), bengio (2), geoffrey (2), hinton (2), oliver (2), rule (2), openai (2), ibm (2), gpt (2), synthesis (2), alexnet (2), protocol (2), neuro (2), source (2), coding (2), improvement (2), rlhf (2), sarsa (2), augmentation (2), regularization (2), bias (2), tradeoff (2), software (2), projects (2), algorithms (2), glossary (2), yarowsky (2), sense (2), zheng (2), xin (2), yong (2), guoyou (2), liu (2), jianguo (2), 3796689 (2), 29425969 (2), 0968 (2), 4328 (2), 1016 (2), 010 (2), 107 (2), fast (2), segmentation (2), white (2), blood (2), cell (2), gupta (2), abhinav (2), efros (2), alexei (2), december (2), 1430 (2), 9062671 (2), 8391 (2), 167 (2), 1505 (2), 05192 (2), 1422 (2), zisserman (2), 2079 (2), 473729 (2), 5386 (2), 1032 (2), 226 (2), 1708 (2), 07860 (2), 2070 (2), external (2), mark (2), florian (2), garrido (2), pierre (2), further (2), reading (2), martin (2), 1145 (2), acm (2), selfapr (2), test (2), execution (2), pmc (2), efficient (2), genomics (2), bootstrap (2), your (2), 2010 (2), empirical (2), google (2), bert (2), pre (2), vincent (2), abstract (2), aaai (2), ponce (2), motion (2), content (2), assran (2), mahmoud (2), ballas (2), nicolas (2), misra (2), ishan (2), michael (2), towards (2), nature (2), variable (2), modelling (2), vicreg (2), invariance (2), covariance (2), pmlr (2), barlow (2), twins (2), canonical (2), jmlr (2), workshop (2), 1476 (2), 355 (2), bibcode (2), com (2), pdf (2), system (2), computing (2), adaptation (2), icml (2), label (2), wav2vec (2), perez (2), 7281 (2), 4803 (2), cvf (2), boosting (2), what (2), like (2), references (2), across (2), diverse (2), fields (2), leverage (2), application (2), domains (2), applied (2), version (2), predictor (2), being (2), given (2), produced (2), results (2), understand (2), particularly (2), each (2), most (2), important (2), information (2), reconstruction (2), current (2), often (2), tasks (2), involves (2), designed (2), require (2), inherent (2), structures (2), generate (2), same (2), time (2), extracted (2), comparison (2), forms (2), jepas (2), structure (2), decision (2), aims (2), they (2), class (2), maximizing (2), agreement (2), constraints (2), cca (2), enforce (2), local (2), zero (2), binary (2), classify (2), requires (2), online (2), side (2), target (2), encoding (2), dimensional (2), into (2), classifier (2), birds (2), distance (2), reconstruct (2), closely (2), during (2), typically (2), difference (2), original (2), error (2), meaningful (2), mean (2), essential (2), predictions (2), risk (2), components (2), manual (2), labeling (2), instance (2), predicted (2), ground (2), truth (2), make (2), recent (2), paradigm (2), relationships (2), theory (2), curve (2), net (2), forest (2), factor (2), anomaly (2), bayes (2), structured (2), dimensionality (2), feature (2), appearance (2), upload (2), file (2), changes (2), read (2), account (2), donate (2), menu (2), add, topic, mobile, cookie, statement, developers, code, conduct, legal, contacts, disclaimers, available, additional, apply, site, you, agree, registered, trademark, profit, organization, wikimedia, foundation, inc, creative, commons, attribution, sharealike, license, rendered, parsoid, edited, utc, dmy, dates, all, https, org, index, php, title, supervised_learning, oldid, 1375949950, workplace, warfare, military, games, marketing, chatbot, psychosis, healthcare, fiction, education, engine, optimization, explainable, environmental, competition, arms, race, anthropomorphism, winter, slop, literacy, infrastructure, effect, center, bubble, boom, social, economic, opposition, centers, propaganda, virtual, politician, regulation, precautionary, nationalism, ethics, elections, takeover, alignment, government, cold, war, political, graph, gnn, adversarial, variational, vae, highway, residual, cnn, multilayer, mlp, echo, gated, unit, memory, vit, differentiable, françois, chollet, kokotajlo, leike, mustafa, suleyman, schulman, aidan, gomez, noam, shazeer, ashish, vaswani, andrej, karpathy, silver, demis, hassabis, ian, goodfellow, quoc, ilya, sutskever, krizhevsky, james, goodnight, graves, stephen, grossberg, lotfi, zadeh, jürgen, schmidhuber, hopfield, paul, werbos, seppo, linnainmaa, seymour, papert, joseph, weizenbaum, bernard, widrow, frank, rosenblatt, selfridge, herbert, simon, cliff, shaw, allen, newell, nathaniel, rochester, mccarthy, marvin, minsky, takeo, kanade, kunihiko, fukushima, shun, ichi, amari, claude, shannon, christopher, manning, von, neumann, walter, pitts, warren, sturgis, mcculloch, alan, people, yago, dbpedia, conceptnet, bases, opencog, lida, clarion, soar, cognitive, reasoners, procedural, logic, programs, inference, engines, expert, deductive, classifiers, robot, control, autogpt, action, selection, muzero, driving, car, five, alphazero, alphago, decisional, watsonx, watson, project, debater, oasis, genie, udio, suno, riffusion, music, generation, veo, seedance, sora, kling, hailuo, runway, gen, dream, stable, recraft, midjourney, imagen, ideogram, flux, firefly, dall, aurora, alphafold, facial, whisper, elevenlabs, ocr, hwr, wavenet, implementations, physical, agent2agent, hypothetical, superintelligence, asi, agi, weak, lethal, weapons, laws, humanity, exam, companion, intelligent, nmt, game, playing, theorem, proving, actor, critic, situated, sovereign, blended, vibe, hallucination, recursive, reflection, llm, post, uncanny, valley, rag, adversary, autoregression, imitation, prompt, weight, initialization, gating, rectifier, sigmoid, softmax, activation, batchnorm, normalization, convolution, attention, backpropagation, conjugate, quasi, newton, sgd, overfitting, double, functions, hyperparameter, parameter, constraint, satisfaction, planning, concepts, lists, proprietary, institutions, companies, timeline, 1995, cambridge, 196, 3115, 981658, 981684, 189, 33rd, annual, meeting, disambiguation, rivaling, balestriero, randall, ibrahim, sobal, vlad, morcos, ari, shekhar, shashank, goldstein, tom, bordes, mialon, gregoire, tian, yuandong, schwarzschild, avi, wilson, gordon, geiping, jonas, fernandez, cookbook, 2304, 12210, martinez, matias, luo, xiapu, zhang, tao, monperrus, 4503, 9475, 3551349, 3556926, 37th, gündüz, hüseyin, anil, binder, xiao, yin, mreches, rené, bischl, bernd, mchardy, alice, münch, philipp, rezaei, mina, 928, 37696966, 10495322, 2399, 3642, s42003, 023, 05310, communications, biology, grill, bastien, strub, altché, florent, tallec, corentin, richemond, buchatskaya, elena, pires, bernardo, avila, guo, zhaohan, azar, mohammad, gheshlaghi, piot, bilal, 2006, 07733, wilcox, ethan, qian, peng, futrell, richard, kohita, ryosuke, levy, roger, ballesteros, miguel, stroudsburg, usa, 4652, 222291675, 18653, 375, 05725, 4640, structural, improves, syntactic, generalization, blog, sourcing, francois, lavet, precup, doina, pineau, joelle, combined, 1809, 04506, littwin, etai, wolf, lior, 3966, 6517610, 8851, 429, 1511, 09033, 3957, multiverse, 2307, 12698, zhengcong, fan, mingyuan, huang, junshi, listen, 2311, 15830, najman, laurent, leveraging, 2403, 00504, duval, bojanowski, piotr, pascal, rabbat, 2301, 08243, openreview, ing, andrades, alvaro, cosenza, marco, raffaele, korbel, 1075, 40709098, 12283373, 2522, 5839, s42256, 025, 01052, 1053, integrating, cancer, 2105, 04906v3, zbontar, jure, jing, deny, stephane, 12320, 12310, 38th, redundancy, galen, arora, raman, bilmes, jeff, livescu, karen, 1255, 1247, 30th, gutmann, hyvärinen, aapo, march, 304, 297, thirteenth, unnormalized, oord, aaron, van, den, yazhe, 1807, 03748, becker, suzanna, 1992, 6356, 163, 1729650, 4687, 355161a0, 1992natur, 161b, 161, organizing, discovers, surfaces, dot, stereograms, demystifying, key, technique, kramer, 1991, 243, 1002, aic, 690370209, 1991aiche, 233k, 233, aiche, journal, nonlinear, principal, component, deng, chen, european, symposium, security, euros, eurosp, 00014, evolving, android, malware, gama, joão, 2014, 2523813, surveys, survey, lee, dong, hyun, challenges, wrepl, simple, gidaris, spyros, bursuc, andrei, komodakis, nikos, patrick, cord, matthieu, 8067, 186206588, 00815, 1906, 05186, 8058, beyer, lucas, zhai, xiaohua, avital, kolesnikov, alexander, 1485, 167209887, 00156, 1905, 03670, s4l, bouchard, louis, medium, will, ever, able, continues, gain, prominence, ability, effectively, opens, possibilities, advancement, especially, driven, perturbations, previous, synthesize, patches, genomenet, directpred, directly, sets, weights, typical, number, predict, point, polysemous, byol, excellent, benchmarks, imagenet, autoregressive, translate, texts, answer, questions, among, things, better, queries, bidirectional, transformers, suitable, developed, perform, build, supervising, combination, losses, kept, compressed, intrinsically, constitutes, because, needs, become, optimal, jargon, refers, setup, design, case, fully, contained, reused, combines, portion, similar, done, belongs, insofar, goal, classified, explicit, correlations, metadata, embedded, present, implicitly, autonomously, domain, operate, entirely, avoiding, pixel, level, focus, just, predicting, masked, visible, been, introduced, step, making, including, founded, included, enable, replicate, intellect, providing, exist, major, moves, beyond, views, preventing, collapse, rooted, includes, jea, invariant, sampling, dlvpm, generalizes, orthogonality, counterintuitively, converges, useful, minimum, reaching, trivial, solution, trivially, effective, extra, back, propagate, mathcal, mathrm, mathbb, frac, sum, infonce, optimize, jointly, nce, set, containing, proposal, distribution, minimizes, following, mid, ldots, clip, allows, pretraining, matching, have, span, angle, having, cosine, similarity, early, maximize, their, divided, those, match, identify, include, contain, both, minimize, presenting, possible, penalizes, reconstructed, minimizing, squared, comes, fact, essentially, associating, achieved, type, consist, maps, lower, reconstructs, decoder, specific, reproduce, words, tasked, captures, allowing, regenerate, many, pipelines, chosen, produces, sufficiently, confident, reducing, propagating, errors, instances, incorporated, refresh, evolve, understanding, emerging, patterns, existing, show, signs, aging, due, distributional, shifts, strategy, reduces, reliance, helping, maintain, performance, adaptive, also, plays, role, must, adapt, properties, change, over, scenarios, detect, incoming, deviates, previously, learned, behavior, generates, result, updating, retraining, becoming, outdated, enables, continuous, dynamic, environments, annotation, automatically, generated, assigns, widely, annotations, limited, unavailable, treating, surrogate, quantities, promising, years, found, practical, others, steps, first, solved, auxiliary, initialize, next, actual, performed, parameters, relying, externally, provided, within, solving, them, capturing, augmented, transformed, creates, serves, formulate, signal, involve, introducing, cropping, rotation, transformations, more, imitates, objects, outline, research, ijcai, iclr, neurips, ecml, pkdd, eccv, journals, conferences, topological, pac, occam, minimization, kernel, mathematical, foundations, roc, confusion, matrix, coefficient, determination, mechanistic, interpretability, loop, crowdsourcing, active, play, temporal, ecram, electrochemical, ram, memtransistor, spiking, physics, informed, radiance, deepdream, lenet, som, restricted, boltzmann, reservoir, esn, feedforward, isolation, outlier, ransac, markov, conditional, graphical, sdl, sne, pgd, pca, nmf, lda, ica, exploratory, shift, optics, dbscan, expectation, maximization, fuzzy, means, hierarchical, cure, birch, support, svm, relevance, rvm, logistic, naive, linear, bagging, ensembles, trees, apprenticeship, ontology, grammar, induction, rank, rules, automl, cleaning, density, modeling, problems, quantum, neuromorphic, curriculum, batch, meta, paradigms, mining, part, series, how, remove, message, please, removing, details, understandable, experts, improve, readers, confused, free, encyclopedia, item, printable, download, print, export, switch, legacy, parser, get, shortened, url, cite, permanent, link, here, actions, english, talk, tiếng, việt, українська, ไทย, português, polski, 한국어, 日本語, italiano, bahasa, indonesia, galego, français, فارسی, español, ελληνικά, deutsch, català, bosanski, العربية, subsection, top, personal, special, pages, community, portal, contribute, events, navigation, jump,
Text of the page (random words):
concept for the world in which they exist 20 unlike autoencoders jepas operate entirely in latent space avoiding pixel level noise to focus on semantic structure rather than just learning invariance jepas learn by predicting masked latent representations from visible context 21 jepa has been applied to domains such as image analysis 22 audio processing 23 and motion in images and video 24 comparison with other forms of machine learning edit ssl belongs to supervised learning methods insofar as the goal is to generate a classified output from the input at the same time however it does not require the explicit use of labeled input output pairs instead correlations metadata embedded in the data or domain knowledge present in the input are implicitly and autonomously extracted from the data these supervisory signals extracted from the data can then be used for training 1 ssl is similar to unsupervised learning in that it does not require labels in the sample data unlike unsupervised learning however learning is not done using inherent data structures semi supervised learning combines supervised and unsupervised learning requiring only a small portion of the learning data be labeled 3 in transfer learning a model designed for one task is reused on a different task 25 training an autoencoder intrinsically constitutes a self supervised process because the output pattern needs to become an optimal reconstruction of the input pattern itself however in current jargon the term self supervised often refers to tasks based on a pretext task training setup this involves the human design of such pretext task s unlike the case of fully self contained autoencoder training 11 in reinforcement learning self supervising learning from a combination of losses can create abstract representations where only the most important information about the state are kept in a compressed way 26 examples edit self supervised learning is particularly suitable for speech recognition for example facebook developed wav2vec a self supervised algorithm to perform speech recognition using two deep convolutional neural networks that build on each other 7 google s bidirectional encoder representations from transformers bert model is used to better understand the context of search queries 27 openai s gpt 3 is an autoregressive language model that can be used in language processing it can be used to translate texts or answer questions among other things 28 bootstrap your own latent byol is a ncssl that produced excellent results on imagenet and on transfer and semi supervised benchmarks 29 the yarowsky algorithm is an example of self supervised learning in natural language processing from a small number of labeled examples it learns to predict which word sense of a polysemous word is being used at a given point in text directpred is a ncssl that directly sets the predictor weights instead of learning it via typical gradient descent 12 self genomenet is an example of self supervised learning in genomics 30 selfapr is an example of self supervised learning applied to automated program repair where a neural model is trained on perturbations of a previous version of the program under repair and uses test execution diagnostics to synthesize patches 31 self supervised learning continues to gain prominence as a new approach across diverse fields its ability to leverage unlabeled data effectively opens new possibilities for advancement in machine learning especially in data driven application domains references edit 1 2 bouchard louis 25 november 2020 what is self supervised learning will machines ever be able to learn like humans medium retrieved 9 june 2021 doersch carl zisserman andrew october 2017 multi task self supervised visual learning 2017 ieee international conference on computer vision iccv ieee pp 2070 2079 arxiv 1708 07860 doi 10 1109 iccv 2017 226 isbn 978 1 5386 1032 9 s2cid 473729 1 2 beyer lucas zhai xiaohua oliver avital kolesnikov alexander october 2019 s4l self supervised semi supervised learning 2019 ieee cvf international conference on computer vision iccv ieee pp 1476 1485 arxiv 1905 03670 doi 10 1109 iccv 2019 00156 isbn 978 1 7281 4803 8 s2cid 167209887 doersch carl gupta abhinav efros alexei a december 2015 unsupervised visual representation learning by context prediction 2015 ieee international conference on computer vision iccv ieee pp 1422 1430 arxiv 1505 05192 doi 10 1109 iccv 2015 167 isbn 978 1 4673 8391 2 s2cid 9062671 zheng xin wang yong wang guoyou liu jianguo april 2018 fast and robust segmentation of white blood cell images by self supervised learning micron 107 55 71 doi 10 1016 j micron 2018 01 010 issn 0968 4328 pmid 29425969 s2cid 3796689 gidaris spyros bursuc andrei komodakis nikos perez patrick perez cord matthieu october 2019 boosting few shot visual learning with self supervision 2019 ieee cvf international conference on computer vision iccv ieee pp 8058 8067 arxiv 1906 05186 doi 10 1109 iccv 2019 00815 isbn 978 1 7281 4803 8 s2cid 186206588 1 2 wav2vec state of the art speech recognition through self supervision ai facebook com retrieved 9 june 2021 lee dong hyun 2013 pseudo label the simple and efficient semi supervised learning method for deep neural networks icml 2013 workshop on challenges in representation learning wrepl gama joão 2014 a survey on concept drift adaptation acm computing surveys 46 4 1 37 doi 10 1145 2523813 xu k li y deng r chen k xu j 2019 self evolving android malware detection system ieee european symposium on security and privacy euros p pp 47 62 doi 10 1109 eurosp 2019 00014 1 2 kramer mark a 1991 nonlinear principal component analysis using autoassociative neural networks pdf aiche journal 37 2 233 243 bibcode 1991aiche 37 233k doi 10 1002 aic 690370209 1 2 3 4 demystifying a key self supervised learning technique non contrastive learning ai facebook com retrieved 5 october 2021 becker suzanna hinton geoffrey e january 1992 self organizing neural network that discovers surfaces in random dot stereograms nature 355 6356 161 163 bibcode 1992natur 355 161b doi 10 1038 355161a0 issn 1476 4687 pmid 1729650 oord aaron van den li yazhe vinyals oriol 22 january 2019 representation learning with contrastive predictive coding arxiv 1807 03748 cs lg gutmann michael hyvärinen aapo 31 march 2010 noise contrastive estimation a new estimation principle for unnormalized statistical models proceedings of the thirteenth international conference on artificial intelligence and statistics jmlr workshop and conference proceedings 297 304 andrew galen arora raman bilmes jeff livescu karen 26 may 2013 deep canonical correlation analysis proceedings of the 30th international conference on machine learning pmlr 1247 1255 zbontar jure jing li misra ishan lecun yann deny stephane 1 july 2021 barlow twins self supervised learning via redundancy reduction proceedings of the 38th international conference on machine learning pmlr 12310 12320 bardes adrien ponce jean lecun yann 11 may 2021 vicreg variance invariance covariance regularization for self supervised learning arxiv 2105 04906v3 cs cv ing alex andrades alvaro cosenza marco raffaele korbel jan o july 2025 integrating multimodal cancer data using deep latent variable path modelling nature machine intelligence 7 7 1053 1075 doi 10 1038 s42256 025 01052 4 issn 2522 5839 pmc 12283373 pmid 40709098 lecun yann 27 june 2022 a path towards autonomous machine intelligence openreview assran mahmoud duval quentin misra ishan bojanowski piotr vincent pascal rabbat michael lecun yann ballas nicolas 13 april 2023 self supervised learning from images with a joint embedding predictive architecture arxiv 2301 08243 cs cv garrido quentin assran mahmoud ballas nicolas bardes adrien najman laurent lecun yann 2024 learning and leveraging world models in visual representation learning arxiv 2403 00504 cs cv fei zhengcong fan mingyuan huang junshi 2023 a jepa joint embedding predictive architecture can listen arxiv 2311 15830 cs sd bardes adrien ponce jean lecun yann 2023 mc jepa a joint embedding predictive architecture for self supervised learning of motion and content features arxiv 2307 12698 cs cv littwin etai wolf lior june 2016 the multiverse loss for robust transfer learning 2016 ieee conference on computer vision and pattern recognition cvpr ieee pp 3957 3966 arxiv 1511 09033 doi 10 1109 cvpr 2016 429 isbn 978 1 4673 8851 1 s2cid 6517610 francois lavet vincent bengio yoshua precup doina pineau joelle 2019 combined reinforcement learning via abstract representations proceedings of the aaai conference on artificial intelligence arxiv 1809 04506 open sourcing bert state of the art pre training for natural language processing google ai blog 2 november 2018 retrieved 9 june 2021 wilcox ethan qian peng futrell richard kohita ryosuke levy roger ballesteros miguel 2020 structural supervision improves few shot learning and syntactic generalization in neural language models proceedings of the 2020 conference on empirical methods in natural language processing emnlp stroudsburg pa usa association for computational linguistics pp 4640 4652 arxiv 2010 05725 doi 10 18653 v1 2020 emnlp main 375 s2cid 222291675 grill jean bastien strub florian altché florent tallec corentin richemond pierre h buchatskaya elena doersch carl pires bernardo avila guo zhaohan daniel azar mohammad gheshlaghi piot bilal 10 september 2020 bootstrap your own latent a new approach to self supervised learning arxiv 2006 07733 cs lg gündüz hüseyin anil binder martin to xiao yin mreches rené bischl bernd mchardy alice c münch philipp c rezaei mina 11 september 2023 a self supervised deep learning method for data efficient training in genomics communications biology 6 1 928 doi 10 1038 s42003 023 05310 2 issn 2399 3642 pmc 10495322 pmid 37696966 ye he martinez matias luo xiapu zhang tao monperrus martin 2022 selfapr self supervised program repair with test execution diagnostics proceedings of the 37th ieee acm international conference on automated software engineering pp 1 13 doi 10 1145 3551349 3556926 isbn 978 1 4503 9475 8 retrieved 28 may 2026 further reading edit balestriero randall ibrahim mark sobal vlad morcos ari shekhar shashank goldstein tom bordes florian bardes adrien mialon gregoire tian yuandong schwarzschild avi wilson andrew gordon geiping jonas garrido quentin fernandez pierre 24 april 2023 a cookbook of self supervised learning arxiv 2304 12210 cs lg external links edit doersch carl zisserman andrew october 2017 multi task self supervised visual learning 2017 ieee international conference on computer vision iccv pp 2070 2079 arxiv 1708 07860 doi 10 1109 iccv 2017 226 isbn 978 1 5386 1032 9 s2cid 473729 doersch carl gupta abhinav efros alexei a december 2015 unsupervised visual representation learning by context prediction 2015 ieee international conference on computer vision iccv pp 1422 1430 arxiv 1505 05192 doi 10 1109 iccv 2015 167 isbn 978 1 4673 8391 2 s2cid 9062671 zheng xin wang yong wang guoyou liu jianguo 1 april 2018 fast and robust segmentation of white blood cell images by self supervised learning micron 107 55 71 doi 10 1016 j micron 2018 01 010 issn 0968 4328 pmid 29425969 s2cid 3796689 yarowsky david 1995 unsupervised word sense disambiguation rivaling supervised methods proceedings of the 33rd annual meeting of the association for computational linguistics cambridge ma association for computational linguistics 189 196 doi 10 3115 981658 981684 retrieved 1 november 2022 v t e artificial intelligence ai history timeline glossary lists algorithms companies institutions projects software open source proprietary concepts automated reasoning automated planning constraint satisfaction knowledge representation parameter hyperparameter loss functions regression bias variance tradeoff double descent overfitting clustering gradient descent sgd quasi newton method conjugate gradient method backpropagation attention convolution normalization batchnorm activation softmax sigmoid rectifier gating weight initialization regularization datasets augmentation prompt engineering reinforcement learning q learning sarsa imitation policy gradient diffusion latent diffusion model autoregression adversary rag uncanny valley llm post training rlhf self supervised learning reflection recursive self improvement hallucination word embedding vibe coding blended ai open source ai sovereign ai symbolic ai neuro symbolic ai situated approach actor critic algorithm applications automated theorem proving general game playing machine learning in context learning artificial neural network deep learning language model large nmt reasoning model context protocol intelligent agent ai agent artificial human companion humanity s last exam lethal autonomous weapons laws generative ai weak ai hypothetical artificial general intelligence agi artificial superintelligence asi agent2agent protocol physical ai implementations audio visual alexnet wavenet human image synthesis hwr ocr computer vision speech synthesis 15 ai elevenlabs speech recognition whisper facial recognition alphafold text to image models aurora dall e firefly flux gpt image ideogram imagen midjourney recraft stable diffusion text to video models dream machine runway gen hailuo ai kling sora seedance veo music generation riffusion suno udio world models genie oasis text list of large language models project debater ibm watson ibm watsonx decisional alphago alphazero openai five self driving car muzero action selection autogpt robot control reasoning systems deductive classifiers expert systems inference engines knowledge based systems logic programs procedural reasoning systems semantic reasoners rule based systems cognitive architectures act r soar clarion lida opencog knowledge bases conceptnet wikidata dbpedia yago people alan turing warren sturgis mcculloch walter pitts john von neumann christopher d manning claude shannon shun ichi amari kunihiko fukushima takeo kanade marvin minsky john mccarthy nathaniel rochester allen newell cliff shaw herbert a simon oliver selfridge frank rosenblatt bernard widrow joseph weizenbaum seymour papert seppo linnainmaa paul werbos geoffrey hinton john hopfield jürgen schmidhuber yann lecun yoshua bengio lotfi a zadeh stephen grossberg alex graves james goodnight andrew ng fei fei li alex krizhevsky ilya sutskever oriol vinyals quoc v le ian goodfellow demis hassabis david silver andrej karpathy ashish vaswani noam shazeer aidan gomez john schulman mustafa suleyman jan leike daniel kokotajlo françois chollet neural network architectures neural turing machine differentiable neural computer transformer vision transformer vit recurrent neural network rnn long short term memory lstm gated recurrent unit gru echo state network multilayer perceptron mlp convolutional neural network cnn residual neural network rnn highway network mamba autoencoder variational autoencoder vae generative adversarial network gan graph neural network gnn politi...
|
