Meta tags:
Headings (most frequently used words):
sensing, the, remote, intelligence, in, agriculture, precision, jiox, analysis, special, issue, holographic, principle, why, deep, learning, works, open, to, international, for, security, rand, and, how, community, satellite, sensors, tradecraft, information, trends, pdf, carpe, datum, rx, sources, subscribe, search, blog, list, archive, crisis, group, crisiswatch, council, on, foreign, relations, crs, recent, reports, center, new, american, conflicts, forum, terrorism, homeland, featured, research, us, cert, current, activity, spy, museum, spycast, think, complex, environments, civil, liberties, privacy, framework, directive, 203, analytic, standards, nasa, large, area, crop, inventory, experiment, lacie, mdpi, powers, corporation, commercial, industry, farming, key, technologies, concepts, airborne, missions, origins, of, potential, sensor, platforms, themselves, what, right, option,
Text of the page (most frequently used words):
the (363), and (164), intelligence (89), that (88), for (55), this (41), with (38), are (35), information (34), data (31), share (30), can (30), #national (28), from (27), #sensing (26), act (26), remote (25), sensors (25), foreign (24), analysis (24), security (22), center (22), network (22), learning (21), systems (20), surveillance (20), have (19), these (17), deep (17), field (17), dni (17), 2007 (16), ago (16), privacy (16), community (15), international (15), terrorism (15), has (15), time (15), more (15), clapper (15), open (14), they (14), one (14), tensor (14), into (14), agriculture (14), collection (14), technology (13), space (13), research (13), november (13), 2008 (13), 2009 (13), years (13), satellite (13), precision (13), documents (13), blog (12), all (12), how (12), civil (12), principle (12), take (12), section (12), source (11), may (11), but (11), what (11), you (11), well (11), networks (11), holographic (11), crop (11), under (11), liberties (11), 2010 (10), 2017 (10), like (10), over (10), will (10), statement (10), commercial (10), pinterest (10), facebook (10), blogthis (10), email (10), posted (10), anonymous (10), theory (10), high (10), their (10), use (10), technologies (10), loading (9), 2011 (9), 2015 (9), not (9), government (9), map (9), however (9), plant (9), regarding (9), work (8), war (8), april (8), other (8), was (8), agency (8), key (8), only (8), just (8), system (8), about (8), dimensional (8), through (8), most (8), which (8), order (8), soil (8), specific (8), director (8), general (8), fisa (8), world (7), media (7), physics (7), new (7), global (7), january (7), july (7), august (7), october (7), march (7), see (7), military (7), law (7), institute (7), office (7), program (7), https (7), pdf (7), make (7), needs (7), there (7), think (7), used (7), such (7), additional (7), type (7), provide (7), yield (7), far (7), spectrum (7), grower (7), 501 (7), metadata (7), declassifies (7), annual (7), library (6), future (6), group (6), december (6), june (6), 2012 (6), related (6), who (6), its (6), advanced (6), any (6), http (6), joint (6), department (6), assessment (6), federal (6), would (6), problem (6), parameters (6), steering (6), farmer (6), executive (6), sensor (6), infrared (6), telephony (6), odni (6), guidelines (6), support (5), health (5), business (5), rand (5), homeland (5), american (5), september (5), 2014 (5), area (5), been (5), weather (5), your (5), solutions (5), access (5), com (5), association (5), studies (5), watch (5), org (5), land (5), mapping (5), fact (5), quantum (5), don (5), between (5), same (5), random (5), machine (5), manifold (5), important (5), should (5), argument (5), different (5), mechanism (5), computation (5), why (5), works (5), generalization (5), paper (5), simple (5), here (5), using (5), low (5), perform (5), also (5), become (5), effective (5), driving (5), some (5), patterns (5), saturday (5), imaging (5), management (5), conditions (5), firms (5), farmers (5), measuring (5), james (5), attorney (5), approves (5), 702 (5), register (5), vol (5), pages (5), universe (4), social (4), design (4), investment (4), environment (4), brain (4), current (4), recent (4), council (4), february (4), counterterrorism (4), many (4), because (4), were (4), wars (4), house (4), look (4), geospatial (4), now (4), changing (4), often (4), entire (4), must (4), easier (4), where (4), posts (4), strategy (4), public (4), defense (4), site (4), special (4), operational (4), imagery (4), based (4), entanglement (4), know (4), neural (4), representation (4), structure (4), capture (4), dimension (4), thin (4), relatively (4), when (4), his (4), idea (4), record (4), way (4), api (4), agricultural (4), farm (4), communications (4), help (4), industry (4), need (4), complex (4), rapidly (4), electromagnetic (4), cameras (4), measure (4), application (4), devices (4), clpt (4), 12333 (4), reform (4), prevention (4), 2004 (4), fisc (4), review (4), court (4), release (4), overview (4), semi (4), compliance (4), web (3), state (3), science (3), potential (3), play (3), growth (3), talk (3), nasa (3), music (3), live (3), leadership (3), language (3), john (3), innovation (3), film (3), energy (3), choice (3), china (3), book (3), big (3), 2018 (3), 2019 (3), policy (3), always (3), camp (3), near (3), easy (3), challenge (3), multiple (3), shows (3), increasingly (3), competitive (3), geoint (3), maps (3), method (3), gave (3), warfare (3), something (3), college (3), list (3), search (3), atom (3), jiox (3), applications (3), online (3), journal (3), tradecraft (3), naval (3), monitor (3), base (3), records (3), resources (3), worldwide (3), threats (3), project (3), pen (3), equipment (3), total (3), tool (3), training (3), human (3), terrain (3), gov (3), cia (3), papers (3), early (3), bird (3), advances (3), gravity (3), error (3), html (3), note (3), had (3), made (3), david (3), even (3), already (3), own (3), good (3), conjecture (3), less (3), able (3), enough (3), both (3), tegmark (3), exists (3), mera (3), intuition (3), natural (3), phenomena (3), authors (3), rethinking (3), above (3), images (3), two (3), difficult (3), explanation (3), trainability (3), yet (3), computational (3), capable (3), number (3), latest (3), higher (3), several (3), going (3), inspirehep (3), net (3), capability (3), follows (3), reduce (3), effectively (3), uses (3), functions (3), cheap (3), than (3), properties (3), possible (3), hologram (3), first (3), hawking (3), today (3), earth (3), airborne (3), nutrients (3), evaluating (3), levels (3), guidance (3), wheel (3), eye (3), navigation (3), gps (3), accurate (3), tasks (3), www (3), operate (3), long (3), competitiveness (3), risks (3), sophisticated (3), recommendations (3), joseph (3), byrum (3), deliver (3), offer (3), standards (3), sharing (3), cost (3), right (3), insight (3), thermal (3), irrigation (3), identify (3), light (3), content (3), available (3), aerial (3), capturing (3), managing (3), modern (3), became (3), provided (3), download (3), sens (3), thursday (3), report (3), releases (3), eric (3), holder (3), renew (3), letter (3), committee (3), pursuant (3), hearing (3), final (3), exemptions (3), nctc (3), environments (3), fight (3), wikipedia (2), video (2), planning (2), transportation (2), transcript (2), ted (2), building (2), software (2), change (2), product (2), performance (2), nature (2), mind (2), marketing (2), life (2), interview (2), green (2), issues (2), flight (2), exploration (2), evolution (2), disease (2), development (2), culture (2), cars (2), art (2), aircraft (2), spy (2), activity (2), conflicts (2), forum (2), crs (2), reports (2), relations (2), crisis (2), 2006 (2), 2013 (2), archive (2), points (2), snowfall (2), poor (2), matters (2), kent (2), production (2), eurasia (2), course (2), thorough (2), led (2), attack (2), mek (2), liberty (2), claims (2), bucket (2), point (2), press (2), quest (2), abbottabad (2), safe (2), notices (2), line (2), communities (2), below (2), tomahawk (2), senior (2), nga (2), delivers (2), via (2), app (2), afcea (2), ukraine (2), forces (2), since (2), impressive (2), constantly (2), might (2), changes (2), brightplanet (2), projects (2), certain (2), analytic (2), techniques (2), increased (2), year (2), read (2), those (2), analysts (2), months (2), experiment (2), army (2), oral (2), exam (2), won (2), sources (2), after (2), affairs (2), comments (2), subscribe (2), links (2), electronic (2), usaf (2), enforcement (2), professionals (2), university (2), strategic (2), air (2), gateway (2), page (2), foundation (2), mipt (2), knowledge (2), directory (2), virtual (2), maritime (2), counter (2), tracking (2), resource (2), jihad (2), database (2), organization (2), camera (2), country (2), case (2), hypothesis (2), llc (2), operations (2), central (2), google (2), technical (2), laboratory (2), congress (2), esri (2), digitalglobe (2), usgs (2), sunday (2), arxiv (2), 1991 (2), conclusion (2), leap (2), our (2), created (2), locality (2), symmetry (2), etc (2), cake (2), conventional (2), optimization (2), bottom (2), layers (2), top (2), thus (2), entirely (2), degrees (2), freedom (2), compression (2), found (2), labels (2), increases (2), small (2), compared (2), true (2), very (2), considering (2), experimental (2), stackgan (2), generating (2), given (2), output (2), provides (2), explanations (2), around (2), expressibility (2), definitely (2), impossible (2), exceedingly (2), does (2), sense (2), show (2), quite (2), although (2), existence (2), representing (2), problems (2), model (2), 2016 (2), proposes (2), convolution (2), models (2), much (2), could (2), move (2), extra (2), researchers (2), further (2), similar (2), circles (2), triangles (2), matrices (2), though (2), 1082123 (2), context (2), depicted (2), value (2), relevant (2), large (2), smaller (2), parts (2), optimizing (2), each (2), part (2), full (2), somewhat (2), proposal (2), lin (2), underlying (2), ideas (2), theorems (2), laws (2), unnatural (2), domain (2), mathematical (2), exponentially (2), back (2), following (2), consequence (2), dynamics (2), wild (2), theoretical (2), let (2), reality (2), paradox (2), concept (2), decades (2), principles (2), follow (2), survey (2), commerce (2), administration (2), planet (2), missions (2), farming (2), concepts (2), ability (2), instance (2), according (2), tractor (2), sprayer (2), integrated (2), collect (2), distance (2), moisture (2), mounted (2), machines (2), location (2), picture (2), geomapping (2), combination (2), allowing (2), off (2), keep (2), automated (2), allows (2), enable (2), achieve (2), accuracy (2), providing (2), positioning (2), within (2), strong (2), greatest (2), themselves (2), companies (2), process (2), highly (2), marketplace (2), best (2), delivery (2), agfundernews (2), editor (2), evolving (2), means (2), growers (2), organizations (2), promote (2), growing (2), making (2), leaves (2), platform (2), option (2), tractors (2), types (2), satellites (2), monitoring (2), others (2), tailored (2), narrow (2), intends (2), wavelength (2), bands (2), heat (2), colors (2), drone (2), areas (2), water (2), get (2), loss (2), salinity (2), difference (2), called (2), vegetation (2), index (2), ndvi (2), red (2), edge (2), crops (2), action (2), useful (2), visible (2), color (2), chlorophyll (2), status (2), short (2), beyond (2), radiation (2), downside (2), advance (2), cloud (2), cover (2), understanding (2), affordable (2), advent (2), view (2), another (2), resolution (2), include (2), count (2), platforms (2), ground (2), combines (2), nutrient (2), before (2), assess (2), manage (2), took (2), actionable (2), commanders (2), analytics (2), heart (2), road (2), traffic (2), job (2), benefits (2), powers (2), published (2), role (2), associated (2), volume (2), issue (2), icd (2), directive (2), framework (2), justice (2), registers (2), trap (2), trace (2), declassification (2), request (2), modify (2), readout (2), meeting (2), president (2), issued (2), authorities (2), nsa (2), senate (2), select (2), activities (2), facts (2), authorized (2), robert (2), litt (2), counsel (2), mitchell (2), remarks (2), delivered (2), procedures (2), protections (2), incorporated (2), united (2), states (2), 248 (2), implementing (2), commission (2), revision (2), 2002 (2), chart (2), adversaries (2), humans (2), awesome, inc, theme, powered, blogger, wunderkind, writing, cultures, women, visualizations, violin, urban, ufo, toy, third, theater, telecom, ted2009, prize, fellows, tech, sustainability, storytelling, statistics, sports, spoken, word, society, sex, robots, religion, race, psychology, productivity, primates, presentation, prediction, poverty, pollution, politics, poetry, piano, photography, philosophy, philanthropy, personal, peace, partner, origami, oceans, news, york, neurology, museums, morality, microbiology, meme, medicine, math, materials, magic, macarthur, grant, love, wooden, invention, interface, insects, industrial, illusion, humor, humanity, history, care, happiness, hack, guitar, god, geology, genetics, gaming, food, fish, faith, evil, epidemiology, entrepreneur, entertainment, engineering, education, economics, dna, disaster, relief, demo, death, dance, curiosity, creativity, consumerism, consciousness, computers, composing, communication, comedy, collaboration, cognitive, climate, cities, children, cello, buddhism, biotech, biosphere, biomechanics, biology, biodiversity, bang, beauty, astronomy, arts, architecture, apes, ants, anthropology, animals, alternative, aids, aging, africa, activism, museum, spycast, cert, featured, crisiswatch, terror, finance, abu, muqawama, zero, agents, flash, singularity, operation, pinky, reaction, greater, metropolitan, legendarily, investments, edition, imperative, family, medical, indefinitely, suspending, windows, almost, seven, window, closing, being, windowoneurasia, abdul, reza, shahlai, irgc, strategist, mujahiden, khalq, members, kept, old, baghdad, quds, force, mastermind, karbala, assault, sure, dumping, ice, head, relentless, discredit, seymour, her, try, setting, isi, billed, diagram, actual, every, node, connections, thinkers, body, vivienne, machi, prepares, combat, threatening, arena, navy, pentagon, official, casts, doubt, missile, ndia, unclassified, verified, users, applicat, signal, articles, washington, times, watched, carefully, armed, began, hybrid, swj, website, structures, surprised, websites, swap, formatting, themes, layout, typ, keeping, developed, victor, platona, andreea, constantinescua, summary, worth, million, financed, meet, monte, carlo, risk, neither, nor, invitation, party, political, rhetoric, adapted, rooiplaas, gathering, becoming, victims, fourth, generation, eeben, barlow, india, largest, consumer, markets, alcohol, brands, spending, capacity, consu, anti, counterfeiting, boost, sales, sproxil, thank, reading, few, people, decided, add, appreciate, held, interes, corner, polarizing, mess, clickbait, headlines, addictive, algorithms, isn, breakdown, transition, better, looks, hamish, mckenzie, tedtalks, ran, comprehensive, four, passed, got, save, methods, days, russia, coming, succession, putin, tinyurl, klsjf6, vhfz, proquest, muir, fairchild, usmc, alfred, gray, walrus, labratory, ndu, merln, cryptome, intelfusion, officers, mit, courseware, diplomacy, dismal, scientist, economist, unit, wall, street, federation, scientists, jamestown, orbat, responder, digital, cybercop, infospace, reverse, cellphone, chase, centre, counterintelligence, interpol, bureau, piracy, shipping, democracies, investigative, monterey, centers, harmony, combating, incident, incidents, preparedness, voices, middle, east, dhimmi, threat, terrorist, profiles, tops, gtd, perspectives, intelcenter, debka, file, intelnews, sigint, nightwatch, omnipeek, link, lincoln, afghan, conflict, latinnews, vitae, axis, intel, gapminder, stratfor, tws, lockheed, martin, anthropac, ucinet, analyst, notebook, chartreader, overwatch, tacops, axispro, coist, palantir, orgnet, seo, palo, alto, competing, ach, forensic, store, humint, pherson, associates, coordinator, doe, osti, quarterly, periscope, jane, arabia, inform, journals, ebsco, host, oxford, analytica, clusty, pandia, scholar, query, manager, completeplanet, shodan, nvivo, starlight, defence, multisearch, engine, nexis, lexis, calibrum, translation, dliflc, modules, portals, division, geofeedia, skyline, terraexplorer, falconview, geoeye, info, topozone, wed, retrieval, portal, warp, iarpa, tel, overseas, advisory, darpa, catalog, sherman, school, occasional, study, pathfinder, intelink, sbu, carpe, datum, home, older, symmetries, fermions, holography, 1407, 6552v2, motls, blogspot, references, reader, psychologist, karl, pribham, physicist, speculated, concrete, relationship, holonomic, bohm, bigger, unsupervised, overlooked, onset, initialization, inability, interpret, problematic, preserves, invariances, yann, lecun, present, icing, cherry, explain, represents, thinking, intrinsic, discovered, contrast, rather, topology, essence, initializations, likely, subject, learned, layer, cannot, possibly, lead, exist, reducing, feasible, remains, constant, factor, mainstream, represent, trained, proceeds, discover, breaks, apart, write, figure, text, descriptions, stages, generative, comprehend, second, generator, captures, image, refinements, plenty, unexplained, plausible, credit, 1612, 03242v1, revolve, ilities, described, consensus, hierarchical, requiring, shallow, questions, difficulty, explaining, away, fit, notion, non, convex, sgd, seems, without, continuous, gans, generalizations, driven, reveals, universal, permits, surprisingly, amnon, shashua, done, oct, novel, kind, tensorial, mixture, dimensionality, solve, spaces, lifted, day, freely, call, hopelessly, intertwined, native, form, linearly, separable, breathing, room, dimensions, studied, recently, miles, stoudenmire, wrote, post, describes, applied, mnist, cifar, writes, approach, putting, wavefunctions, written, earlier, similarities, step, uniform, exhibit, entanglements, flows, input, either, fully, connected, similarly, entangled, memories, words, 1372114, depict, disentanglers, isometries, nodes, perspective, matrix, vector, realize, arises, hierarchy, matter, embodies, mutual, chain, rule, drastically, focuses, primary, motivation, behind, decomposing, manageable, then, performed, optimizes, larger, underpinning, easily, tensorflow, notation, article, bold, analogous, proposed, genesis, leverages, mechanisms, specifically, extremely, paltry, bring, promising, flattening, renormalization, sufficiently, convinced, assumes, domains, identifying, creating, playing, trivial, examples, clearly, fair, discuss, detail, known, guarantee, approximate, arbitrary, class, practical, interest, approximated, fewer, generic, ones, simplifying, tracing, exceptional, simplicity, hinges, compositionality, polynomial, log, probability, explore, translate, exceptionally, approximating, abstract, representations, thereof, drawings, meantime, coincidentally, impressively, max, henry, harvard, volunteered, argue, surprising, particles, equal, size, surface, proportional, begs, question, mistaken, fringe, appears, quire, apparently, rests, solid, underpinnings, say, stephen, remarked, rubbish, finally, agreed, conclusions, start, deriving, theories, explains, interact, construct, motivations, comes, theorized, black, holes, emanate, fundamental, violated, destroyed, experimentation, physicists, brought, forth, unified, theoretic, projection, fascinating, arrow, mere, manifestations, sheet, want, dec, methodology, intuitionmachine, carlos, perez, python, console, qgis, arcgis, usda, apex, epic, illinois, geological, observation, eros, landinfo, sentinel, hub, imagesat, ast, rthc, rfsa, roscosmos, aeronautics, jaxa, japan, aerospace, european, esa, cnsa, geos, noaa, ahvrr, observing, phased, array, band, sar, alos, palsar, deimos, geosys, includes, skybox, terrabella, blackkridge, labs, spot, lookviewer, landsat, miscellaneous, cema, agri, trends, adapt, apply, seed, fertiliser, exact, variations, variable, rate, vrt, components, example, dealer, spray, compaction, diseases, moving, produce, including, assign, particular, left, caption, seeder, depending, shape, intelligent, control, driver, hands, during, trips, down, row, planter, drivers, still, steer, assisted, auto, overhead, turning, edges, overlapping, rows, anywhere, anytime, position, geographic, coordinates, latitude, longitude, locate, navigate, vehicles, 2cm, pubs, monograph_reports, mr1469, begun, aiming, succeed, run, reliable, policies, encourage, presence, sound, plans, ensure, domestic, marketplaces, come, transforming, providers, competitors, age, master, operating, requirement, addition, policymaking, degree, predictability, timeliness, transparency, expected, conclude, six, adopt, fulfill, responsibilities, promoting, encouraging, private, kim, gavin, frelinger, steven, berner, beth, lachman, baker, connell, kevin, corporation, sciences, syngenta, regular, contributor, trial, determine, shelf, products, quick, fix, scientifically, validated, contribute, increasing, profits, market, startup, formed, hardware, packages, mature, viable, propositions, likewise, working, ways, interested, too, options, aspects, suppliers, tend, proprietary, vendors, west, situation, limited, interoperability, inconvenient, weigh, against, capital, outside, ubiquitous, precise, positional, things, self, various, stations, allow, logging, environmental, rain, temperature, sunlight, factors, radar, microwave, cut, powerful, across, continents, designed, broad, swaths, while, slices, depend, accomplish, peer, represented, shortly, irrigating, send, equipped, lwir, readily, aren, receiving, helps, beginning, preventing, sign, threatens, yields, salty, reflectance, normal, reflect, cell, damaged, abnormal, consistent, express, normalized, nir, stressed, precisely, giving, corrective, find, closer, blue, peering, wave, spectral, appropriate, vary, ask, suited, task, hand, past, wasn, captured, slice, gamma, end, frequency, radio, waves, coverage, vast, especially, calculating, losses, severe, events, conducting, assessments, initially, main, aside, tasked, usually, worst, ruin, expensive, purchase, governments, opened, databases, accessible, places, reach, attached, airplanes, slowly, altitude, typical, population, weed, detection, estimates, wind, limit
Text of the page (random words):
lid experimental and theoretical underpinnings let s just say that stephen hawking who first remarked that is was rubbish has finally agreed to its conclusions so at this time it should be relatively safe to start deriving some additional theories of this principle one surprising consequence of this theory is that the hologram is able to capture the dynamics of the universe that has of the order of d n degrees of freedom where d is the dimension and n is the number of particles one would think that the hologram would be of equal size but it is not it is a surface area and is proportional only to n² this begs the question how is an structure of order n² able to capture the dynamics of a system in d n in the meantime deep learning dl coincidentally has a similar mapping problem researchers don t know how it is possible for dl to perform so impressively well considering the problem domain s search space has an exceedingly high dimension so max tegmark and henry lin of harvard have volunteered their own explanation why does deep and cheap learning work so well in their paper they argue the following although well known mathematical theorems guarantee that neural networks can approximate arbitrary functions well the class of functions of practical interest can be approximated through cheap learning with exponentially fewer parameters than generic ones because they have simplifying properties tracing back to the laws of physics the exceptional simplicity of physics based functions hinges on properties such as symmetry locality compositionality and polynomial log probability and we explore how these properties translate into exceptionally simple neural networks approximating both natural phenomena such as images and abstract representations thereof such as drawings the authors bring up several promising ideas like the no flattening theorems as well as the use of information theory and the renormalization group as explanations for their conjecture i however was not sufficiently convinced by their argument the argument assumes that all problem data follows natural laws but as we all know that dl can be effective in unnatural domains see identifying cars driving creating music and playing go as trivial examples of clearly an unnatural domain to be fair i think that they were definitely on to something and that something i discuss in more detail in this article i make a bold proposal with an argument that is somewhat analogous to what tegmark and lin proposed deep learning works so well because of physics however the genesis of my idea is that dl works because it uses the leverages the same computational mechanisms underlying the holographic principle specifically the capability of representing an extremely high dimensional space i e d n with a paltry number of parameters of the order n² the computational mechanism underpinning the holographic principle can be most easily depicted through the use of tensor networks note these are somewhat different from the tensorflow or the neural tensor network tensor network notation is as follows source http inspirehep net record 1082123 the value of tensor networks in physics is that they are used to drastically reduce the state space into a network that focuses only on the relevant physics the primary motivation behind the use of tensor networks is to reduce computation a tensor network is a way to perform computation in a high dimensional space by decomposing a large tensor into smaller more manageable parts the computation can then be performed with smaller parts at a time by optimizing each part one effectively optimizes the full larger tensor in the context of the holographic principle the mera tensor is used and it is depicted as follows source http inspirehep net record 1082123 in above the circles depict disentanglers and the triangles isometries one can look at the nodes from the perspective of a mapping that is the circles map matrices to other matrices the triangles take a matrix and map it to a vector the key though here is to realize that the compression capability arises from the hierarchy and the entanglement as a matter of fact this network embodies the mutual information chain rule source https inspirehep net record 1372114 in other words as you move from the bottom to the top of the network the information entanglement increases i ve written earlier about the similarities of deep learning with holographic memories however here i m going to make one step further deep learning networks are also tensor networks deep learning networks however are not as uniform as a mera network however they exhibit similar entanglements as information flows from input to output in either a fully connected network or a convolution network the information are similarly entangled the use of tensor networks has been studied recently by several researchers miles stoudenmire wrote a blog post tensor networks putting quantum wavefunctions into machine learning where he describes his method applied to mnist and cifar 10 he writes about one key idea about this approach the key is dimensionality problems which are difficult to solve in low dimensional spaces become easier when lifted into a higher dimensional space think how much easier your day would be if you could move freely in the extra dimension we call time data points hopelessly intertwined in their native low dimensional form can become linearly separable when given the extra breathing room of more dimensions amnon shashua et al have also done work in this space their latest paper oct 2016 tensorial mixture models proposes a novel kind of convolution network in conclusion the holographic principle although driven by quantum computation reveals to us the existence of a universal computational mechanism that is capable of representing high dimensional problems using a relatively low number of model parameters my conjecture here is that this is the same mechanism that permits deep learning to perform surprisingly well most explanations about deep learning revolve around the 3 ilities that i described here these are expressibility trainability and generalization there is definitely consensus in expressibility that is of a hierarchical network requiring less parameters that a shallow network the open questions however are that of trainability and generalization the big difficulty in explaining away these two is that they don t fit with any conventional machine learning notion trainability should be impossible in a high dimensional non convex space however simple sgd seems to work exceedingly well generalization does not make any sense without a continuous manifold yet gans show quite impressive generalizations credit https arxiv org pdf 1612 03242v1 pdf the above figure shows the stackgan generating given text descriptions output images in two stages for the stackgan there are two generative networks and it is difficult to comprehend how the second generator captures only image refinements there are plenty of unexplained phenomena like this the holographic principle provides a base camp to a plausible explanation the current mainstream intuition of why deep learning works so well is that there exists a very thin manifold in high dimensional space that can represent the natural phenomena that it is trained on learning proceeds through the discover of this thin manifold this intuition however breaks apart considering the recent experimental data see rethinking generalization the authors of the rethinking generalization paper write even optimization on random labels remains easy in fact training time increases only by a small constant factor compared with training on the true labels both the tegmark argument and the thin manifold argument cannot possibly work with random data this thus lead to the hypothesis that there should exist an entirely different mechanism that is reducing the degrees of freedom or problem dimension so that computation is feasible this compression mechanism exists can be found in the structure of the dl network just like it exists in the mera tensor network conventional machine learning thinking is that it is the intrinsic manifold structure of the data that needs to be discovered via optimization in contrast my conjecture claims that the data is less important rather it is the topology of the dl network that is able to capture the essence of the data that is even if the bottom layers have random initializations it is likely that the network should work well enough subject to a learned mapping at the top layer in fact i would even make a bigger leap in that in our quest for unsupervised learning we may have already overlooked the fact that a neural network has already created its own representation of the data at onset of random initialization it is just our inability to interpret that representation that is problematic a random representation that preserves invariances i e locality symmetry etc may just be a good as any other representation yann lecun s cake might already be present and that it is just the icing and cherry that needs to explain what the cake represents note to reader in 1991 psychologist karl pribham with physicist david bohm had speculated about holonomic brain theory i don t know the concrete relationship between the brain and deep learning so i can t make the same conclusion that they made in 1991 references http motls blogspot com 2015 03 quantum gravity from quantum error html https arxiv org pdf 1407 6552v2 pdf advances on tensor network theory symmetries fermions entanglement and holography posted by anonymous on sunday january 22 2017 email this blogthis share to x share to facebook share to pinterest older posts home subscribe to posts atom carpe datum rx loading open sources intelink sbu open source center pathfinder early bird cia world fact book cia center for the study of intelligence cia sherman kent school of intelligence analysis occasional papers the national security archive data gov darpa open catalog council on foreign relations national intelligence council conflicts forum overseas security advisory council in q tel iarpa national geospatial intelligence agency wed based access and retrieval portal warp geoint online usgs satellite imagery topozone land info worldwide mapping llc geoeye digitalglobe esri falconview skyline terraexplorer geofeedia library of congress federal research division country studies library of congress portals to the world center for advanced operational culture learning human terrain systems laboratory for human terrain defense language institute foreign language center dliflc field support modules national virtual translation center calibrum lexis nexis defence technical information center multisearch engine future point systems starlight nvivo shodan completeplanet deep query manager deep web research google scholar pandia search central clusty wikipedia oxford analytica ebsco host directory of open access journals arabia inform jane s military periscope joint forces quarterly special operations technology doe osti office of the coordinator for counterterrorism s ct open crs rand national defense research institute center for intelligence research and analysis center for naval analysis pherson associates llc humint training solutions forensic store palo alto research center analysis of competing hypothesis ach tool seo analysis orgnet social network analysis palantir overwatch tacops axispro coist map ht i2 analyst notebook chartreader anthropac ucinet lockheed martin center for security analysis tws ic case method program total intelligence solutions stratfor international assessment and strategy center intelligence online country watch gapminder world total intel watch map threats watch site intelligence group axis information analysis china vitae latinnews com afghan conflict monitor security camera surveillance equipment pen link lincoln omnipeek nightwatch intelnews org sigint debka file intelcenter perspectives on terrorism mipt terrorism knowledge base global terrorism database gtd terrorist organization profiles tops tracking the threat jihad watch dhimmi watch the middle east media research institute rand voices of jihad database terrorism preparedness data resource center worldwide incidents tracking system global incident map terrorism research center threats open source intelligence gateway center for defense information terrorism project international institute for counter terrorism combating terrorism center harmony project monterey institute of international studies research centers the investigative project on terrorism foundation for defense of democracies office of naval intelligence civil maritime analysis department worldwide threats to shipping reports international maritime bureau live piracy map interpol centre for counterintelligence and security studies virtual chase public records information resources reverse cellphone directory infospace cybercop homeland security digital library mipt responder knowledge base orbat foreign policy center for a new american security the jamestown foundation federation of american scientists strategy page the wall street journal economist intelligence unit business monitor international dismal scientist diplomacy monitor usaf air war college intelligence gateway strategic studies institute of the u s army war college university of military intelligence mit open courseware association for intelligence officers international studies association national military intelligence association naval intelligence professionals international association of law enforcement intelligence analysts afcea international online journal of foreign affairs and tradecraft intelligence is the future blog intelligence applications analysis for law enforcement intelfusion blog cryptome ndu merln library walrus warfare analysis labratory usmc alfred m gray research center usaf muir s fairchild research information center joint electronic library proquest more links subscribe to jiox posts atom posts all comments atom all comments http tr im vhfz http tinyurl com klsjf6 search blog list foreign affairs after putin russia s coming succession crisis 2 days ago sources and methods your oral exam won t save you we just ran an experiment where we gave the us army war college s oral comprehensive exam to four commercial ai systems they all passed one got an a 3 months ago tedtalks video this is what the future of media looks like hamish mckenzie what if the polarizing mess of social media clickbait headlines and addictive algorithms isn t a breakdown of media but a transition to something better 1 year ago analysts corner this blog thank you for reading this blog since only a few people read it i have decided to not add any more to it i appreciate those of you who have held interes 1 year ago sproxil blog anti counterfeiting a key to boost sales india has one of the largest consumer markets for alcohol in the world with easier ac...
|
