Meta tags:
Headings (most frequently used words):
-
Text of the page (most frequently used words):
the (145), com (82), https (67), that (66), and (62), infiniteundo (47), post (47), software (36), noahsussman (35), with (35), testing (34), href (31), code (29), are (26), for (25), not (23), strong (22), src (21), blockquote (20), devops (19), have (19), 0400 (18), can (18), this (18), systems (18), http (17), you (17), 2017 (16), twitter (16), img (16), but (14), how (14), system (14), because (13), from (11), rot (11), may (10), what (10), data (10), programming (10), quality (10), csv (10), human (9), like (9), then (9), test (9), amazon (9), border (9), memes (8), other (8), computer (8), all (8), script (8), they (8), one (8), jun (8), important (8), view (7), www (7), class (7), which (7), programmers (7), same (7), widgets (7), complex (7), such (7), title (7), tumblr (7), checking (7), about (7), time (7), lot (7), narrative (7), programs (6), into (6), org (6), using (6), some (6), any (6), implementation (6), only (6), been (6), lang (6), when (6), example (6), state (6), bad (6), teleonomy (6), between (6), media (6), png (6), assurance (6), sun (6), alt (6), discussion (6), cartesian (6), need (6), people (6), change (6), think (6), style (6), margin (6), utf8 (6), tag (6), adsystem (6), hypothesis (6), process (6), composed (5), web (5), must (5), use (5), looking (5), meme (5), complete (5), language (5), mon (5), good (5), back (5), their (5), has (5), know (5), them (5), nor (5), observed (5), program (5), features (5), jpg (5), development (5), just (5), don (5), json (5), miller (5), engagement (5), life (5), much (5), history (5), proposition (4), functional (4), building (4), over (4), see (4), creative (4), behavior (4), itself (4), work (4), agile (4), management (4), async (4), platform (4), charset (4), utf (4), after (4), toward (4), pursue (4), goal (4), way (4), well (4), makes (4), rationalwiki (4), concern_troll (4), concern (4), width (4), height (4), will (4), find (4), out (4), open (4), problem (4), policing (4), most (4), yet (4), xml (4), uncomfortable (4), dev (4), learn (4), product (4), subsystems (4), day (4), requirements (4), camp (4), 0131177052 (4), 0201485672 (4), 0132350882 (4), news (4), specification (4), ross (4), analysis (4), feedback (4), observability (4), fri (3), individual (3), point (3), paper (3), patterns (3), selfish (3), object (3), design (3), collaborating (3), order (3), new (3), evolve (3), instance (3), there (3), those (3), tweet (3), dir (3), ltr (3), part (3), was (3), words (3), tentacular (3), status (3), automation (3), legacy (3), put (3), already (3), easy (3), our (3), intent (3), very (3), consistency (3), functioning (3), goals (3), without (3), agents (3), past (3), working (3), always (3), sense (3), while (3), bugs (3), considered (3), talk (3), currently (3), modern (3), wiki (3), around (3), fucking (3), far (3), form (3), first (3), feel (3), reason (3), source (3), imgur (3), sed (3), sort (3), comes (3), pretty (3), articles (3), foss (3), truth (3), relationship (3), increasingly (3), intelligent (3), technical (3), debt (3), cycle (3), long (3), its (3), optimally (3), fact (3), bit (3), phases (3), begin (3), call (3), books (3), ignored (3), 3em (3), target (3), _blank (3), ref (3), as_li_tl (3), 1789 (3), 9325 (3), creativeasin (3), linkcode (3), as2 (3), linkid (3), _encoding (3), marketplace (3), asin (3), serviceversion (3), 20070822 (3), asinimage (3), format (3), _sl250_ (3), am2 (3), none (3), 0px (3), hacker (3), list (3), diagram (3), more (3), lean (3), 2018 (3), organizations (3), kübler (3), 2019 (3), standard (3), toad (3), discrete (3), events (3), 161099321803 (2), decomposed (2), expressed (2), modules (2), rather (2), stakeholders (2), takes (2), level (2), question (2), might (2), opposed (2), 161099794448 (2), gets (2), wrong (2), should (2), obviously (2), number (2), infinite (2), ways (2), pattern (2), phenotypes (2), identify (2), single (2), last (2), years (2), does (2), 161220681943 (2), making (2), acceptable (2), removing (2), extreme (2), cdio1kspf2 (2), 161242603758 (2), tue (2), shape (2), gradually (2), take (2), case (2), under (2), principle (2), required (2), collaboration (2), defining (2), qwan (2), internal (2), humans (2), practical (2), memory (2), characteristics (2), also (2), amazing (2), autotuning (2), sandpile (2), model (2), seen (2), resorting (2), metaphor (2), future (2), reality (2), eventually (2), own (2), sympoiesis (2), dijkstra (2), said (2), bug (2), programmer (2), implies (2), everything (2), name (2), 161323522783 (2), series (2), band (2), pass (2), 161432499348 (2), vision (2), sympoietic (2), praxis (2), 161716045283 (2), troll (2), revolves (2), whether (2), establishing (2), often (2), trolling (2), community (2), place (2), who (2), explain (2), everyone (2), written (2), either (2), narcissists (2), 161741983358 (2), github (2), parsing (2), flickr (2), awk (2), tabular (2), here (2), structured (2), tool (2), xmlstarlet (2), found (2), results (2), achieve (2), even (2), pre (2), 161813978333 (2), wed (2), illustration (2), funnel (2), 161969662853 (2), june (2), 161976212873 (2), suboptimization (2), outside (2), cgtn57mrt4 (2), skjykuvv4o (2), world (2), 162239034463 (2), database (2), server (2), historical (2), java (2), contains (2), suited (2), despite (2), agreed (2), upon (2), changes (2), environment (2), phenomenon (2), come (2), production (2), solutions (2), problems (2), social (2), squishy (2), hard (2), idea (2), html (2), topic (2), boot (2), believe (2), successfully (2), dealt (2), old (2), discourse (2), div (2), right (2), 163803222253 (2), aug (2), front (2), posts (2), full (2), 164948026688 (2), subset (2), cdt (2), tdd (2), driven (2), thing (2), both (2), impossible (2), since (2), 175476025038 (2), works (2), large (2), curve (2), six (2), your (2), 179788377788 (2), nov (2), 0500 (2), stuff (2), 179788828168 (2), applied (2), 185199529408 (2), phenotypic (2), conformance (2), describes (2), static (2), ruleset (2), properties (2), codebase (2), existing (2), 185224298983 (2), developers (2), rate (2), respond (2), 187241989448 (2), o11y (2), safety (2), connections (2), frames (2), reconstructed (2), framework (2), comprehensible (2), prediction (2), predict (2), formal (2), eloquently, white, archive, 20000919041410, joeyoder, papers, pdf, examines, oriented, structural, vernacular, shared, fluid, few, arching, rules, eye, reuse, evolution, artifact, able, attract, survive, flourish, addresses, encourage, ones, intelligence, algorithms, abstraction, want, behaving, cunning, brutal, creatures, animal, kingdom, look, memeplexes, phenotype, particular, concrete, turing, technically, express, behind, study, miss, basically, structuralist, approaches, trying, downplaying, 863854375743229952, converge, snap, deformed, autoscaling, regain, event, impacted, functionality, act, pushed, better, edge, familiar, edges, untestedness, again, confirms, intuitively, collaborate, seem, adversarial, interactions, shows, neither, antagonism, requires, 161212025908, timeless, chapter, alexander, clear, inner, conflict, pursuing, aligned, sufficient, say, alignment, qualifies, fully, snapping, simple, characteristic, cellular, automata, nautil, issue, dominoes, sandpiles, show, remarkably, abelian, computers, remember, difficult, regard, having, motivations, align, lenses, through, once, crept, wasn, intellectually, dishonest, originally, turn, calls, statement, originate, agent, instead, defined, collaborative, interaction, creep, agency, according, thu, b04dd4676f785f187b74ff5b96ffcce0, tumblr_oqvtbixtkh1rswam8o1_500, f4fe4456b828a4cd2a4f11955da3cbf7, tumblr_oqvtbixtkh1rswam8o2_500, filters, these, pair, slides, developing, moment, moments, 871415119082926081, codeascraft, etsy, image, sjwiki, images, thumb, 300px, 300, 560, thumbimage, hoverzoomlink, leading, sqa, conferences, today, including, gtac, stpcon, star, cast, various, selenium, confs, short, 141887918393, dualism, divide, effected, role, bothers, although, division, fashion, luminaries, myself, certainly, utility, certain, foundational, local, taxa, architects, jerks, 146651832083, letter, testers, chain, though, god, damned, biggest, goes, microagressions, stop, apologize, softwaretestingclub, forum, topics, club, online, common, aka, tone, correcting, choose, automators, activities, personally, interrupted, speaking, conference, least, three, times, interruptor, isn, yeah, motherfucker, knew, give, shit, becasue, perspective, minutia, interrupting, professionals, corret, trivial, choices, uncool, best, viewed, dispassionate, light, elitist, immature, alienating, won, wasted, persists, medium, marlenac, blood, bag, tech, b6c78ae2aa5e, free, commandline, bash, ofzuwdal, photo, blavandmaster, johnkerl, cut, join, indexed, tsv, pipe, 158798797433, slice, filter, map, transform, ease, grep, friends, let, play, text, choice, processing, sorts, except, handled, freesoftwaremagazine, xml_starlet, unix, toolkit, never, liked, make, 99336704013, convert, honest, substandard, anyway, solves, install, homebrew, compile, mlr, c2j, cat, my_file, now, spent, learning, enjoy, madewithpaper, pyramid, 36514efcc3f4fd92972d0af60d6b7cb9, tumblr_orjiyqtbla1rswam8o1_500, developer, systemsthinking, 614973750795091969, 2015, hashtag, hash, pic, 876526313133223936, ddhzycfl, rotten, bridge, ahia, predictable, lived, outgrow, service, begins, monolithic, scales, capacity, increase, distributed, original, infoq, dependence, activerecord, orm, replaced, variety, databases, services, reasons, canonical, definition, did, function, concept, metaphorically, encapsulates, precede, frictionless, still, wears, course, meaning, satisfy, empowered, group, inevitably, exhibit, related, hosting, called, caused, continue, hands, users, understood, area, science, contribute, algorithmic, environmental, aesthetic, space, taken, collaborators, soft, skill, engaging, opportunity, heuristics, would, allow, distinguish, issues, taking, softwareengineering, stackexchange, questions, 255866, meant, known, wikipedia, software_rot, documented, catb, jargon, literature, commonly, solution, job, interviews, performance, evaluations, contraventions, listed, general, taught, coding, camps, recognizes, importance, sure, feels, comfortable, giving, advice, almost, term, subsystem, upgrades, solving, knowledge, locked, away, couple, side, sell, junior, engineer, fresh, undergrad, recent, movement, thinking, hopeful, sign, concerns, deal, changing, hasn, forthcoming, growth, hype, ten, top, 51b75a3fde75d5ab937198f6296d31c6, 5cabea402e4aea572aefd4b67408320c, 8efca92ce5a61b4c4ea2d1def5072657, ycombinator, item, 14930573, thanks, upvoting, exciting, page, 158991836448, risk, sep, ilm6xqtl, venn, showing, overlap, context, writing, different, haven, enough, admittedly, controversial, opinion, activity, implement, prefer, holds, corollary, consider, constrained, laws, nature, incomplete, proceed, decide, modifying, repeating, levels, stack, functionally, could, exist, largest, application, derpiest, hello, cannot, implemented, built, iteratively, via, validation, hypotheses, thorough, exploration, read, refer, patb_paper, theory, peter, naur, 1985, engineering, invalidation, accenture, transformations, digital, kubler, waterfall, kanban, scrum, jul, 6215db73774a0f05948c90208786110d, tumblr_pb8zgyi3yx1rswam8o1_500, project, two, tested, visualizing, cope, together, hope, infographic, helps, every, initiative, portfolio, 824e8f9ee36e77d869b5b43941be853f, tumblr_phq2zr63qe1rswam8o1_500, eb18eb8aaae06932ce6cb20d2ff8ec2e, tumblr_phq3xhdvqh1rswam8o1_500, epistemology, brett, pettichord, practice, based, than, voted, team, initial, loop, changesets, resemble, speaks, absence, syntax, errors, normative, risks, fit, practices, lead, bikeshedding, metric, where, engage, rates, calculated, measurement, tools, facing, email, frequency, slack, announcements, failing, tests, fixed, startup, sat, mental, disciplines, naturally, become, obvious, conversely, rooted, traditional, edited, finite, luck, explaining, why, lets, quickly, unknowns, techniques, nice, necessary, however, accept, little, culture, resiliency, btw, obliquely, being, gotten, clay, shirkey, quote, embedded, reaction, prior, stupidity, means, reactive, follows, great, specificity, operate, mainly, off, taxonomies, failures, try, derive, ontologies, address, undo, reading, sharealike, 2025, noah, sussman,
Text of the page (random words):
cally encapsulates the life cycle phases that precede this sort of legacy system p h3 frictionless yet it still wears out h3 p the observed course of the strong software development life cycle strong is that features begin life in a working state meaning that they satisfy the requirements agreed upon by an empowered group of stakeholders but that inevitably the same features begin to exhibit bugs that are not in any way related to changes of code nor hosting environment strong software rot strong as this phenomenon has come to be called is caused because the em requirements em for features continue to change and evolve even after such features are in the hands of their users p blockquote p the system contains subsystems that are not optimally suited to day to day functioning p blockquote p this is not a well understood area of software production nor does computer science have much to contribute by way of solutions the problems are not algorithmic but environmental social aesthetic in other words it is what programmers like to call a em squishy problem em because so much of the problem space is taken up not by software but by humans and their co collaborators p h3 in programming soft skill is hard h3 p the idea of engaging with em squishy problems em is uncomfortable to a lot of programmers i think this is because programmers currently do not have an opportunity to learn the heuristics that would allow them to distinguish good solutions from bad when it comes to human and social issues p p taking strong software rot strong as an example it is a a href https softwareengineering stackexchange com questions 255866 what is meant by code rot well known a phenomenon a href https en m wikipedia org wiki software_rot long documented a in a href http www catb org jargon html b bit rot html the literature a of software yet it has no commonly agreed up on solution its management is not a topic of discussion in job interviews nor in performance evaluations for the most part the contraventions for strong software rot strong are not listed in general programming books nor taught in coding boot camps p p i do not believe that strong software rot strong is ignored as a topic because no one recognizes its importance i m pretty sure it s ignored because no one feels comfortable giving advice about it because almost no one has successfully em dealt em with the long term requirements changes and subsystem upgrades that go with solving strong software rot strong p p the knowledge about how this problem have been successfully dealt with are locked away in a couple of books and those books are old using server side programming and java as their example environment that s a hard sell to a junior engineer fresh out of a boot camp or undergrad program p p the recent movement toward systems thinking in software is a hopeful sign but we need modern discourse that concerns how to deal with changing requirements over time and so far such discourse hasn t been forthcoming despite all the growth and hype about code over the last ten years p div style margin top 3em a style margin right 3em target _blank href https www amazon com gp product 0131177052 ref as_li_tl ie utf8 camp 1789 creative 9325 creativeasin 0131177052 linkcode as2 tag noahsussman 20 linkid 51b75a3fde75d5ab937198f6296d31c6 img border 0 src ws na amazon adsystem com widgets q _encoding utf8 marketplace us asin 0131177052 serviceversion 20070822 id asinimage ws 1 format _sl250_ tag noahsussman 20 a img src ir na amazon adsystem com e ir t noahsussman 20 l am2 o 1 a 0131177052 width 1 height 1 border 0 alt style border none important margin 0px important a style margin right 3em target _blank href https www amazon com gp product 0201485672 ref as_li_tl ie utf8 camp 1789 creative 9325 creativeasin 0201485672 linkcode as2 tag noahsussman 20 linkid 5cabea402e4aea572aefd4b67408320c img border 0 src ws na amazon adsystem com widgets q _encoding utf8 marketplace us asin 0201485672 serviceversion 20070822 id asinimage ws 1 format _sl250_ tag noahsussman 20 a img src ir na amazon adsystem com e ir t noahsussman 20 l am2 o 1 a 0201485672 width 1 height 1 border 0 alt style border none important margin 0px important a target _blank href https www amazon com gp product 0132350882 ref as_li_tl ie utf8 camp 1789 creative 9325 creativeasin 0132350882 linkcode as2 tag noahsussman 20 linkid 8efca92ce5a61b4c4ea2d1def5072657 img border 0 src ws na amazon adsystem com widgets q _encoding utf8 marketplace us asin 0132350882 serviceversion 20070822 id asinimage ws 1 format _sl250_ tag noahsussman 20 a img src ir na amazon adsystem com e ir t noahsussman 20 l am2 o 1 a 0132350882 width 1 height 1 border 0 alt style border none important margin 0px important div https infiniteundo com post 162239034463 https infiniteundo com post 162239034463 sun 25 jun 2017 10 52 15 0400 devops testing quality assurance code learn to code noahsussman suboptimization is the reason for technical debt but i have to go outside of programming world to find discussion of it blockquote class twitter tweet data lang en p lang en dir ltr suboptimization is the reason for technical debt but i have to go outside a href https twitter com hashtag programming src hash programming a to find discussion of it a href https t co cgtn57mrt4 https t co cgtn57mrt4 a a href https t co skjykuvv4o pic twitter com skjykuvv4o a p tentacular devops noahsussman a href https twitter com noahsussman status 876526313133223936 june 18 2017 a blockquote script async src platform twitter com widgets js charset utf 8 script https infiniteundo com post 161976212873 https infiniteundo com post 161976212873 sun 18 jun 2017 15 47 57 0400 devops technical debt noahsussman the uncomfortable truth is that dev is a complex relationship with an increasingly intelligent other blockquote p the uncomfortable truth is that dev is a complex relationship with an increasingly intelligent other p blockquote blockquote class twitter tweet data lang en p lang en dir ltr the uncomfortable truth is that dev is a complex relationship with an increasingly intelligent other p tentacular devops noahsussman a href https twitter com noahsussman status 614973750795091969 june 28 2015 a blockquote script async src platform twitter com widgets js charset utf 8 script https infiniteundo com post 161969662853 https infiniteundo com post 161969662853 sun 18 jun 2017 12 17 17 0400 devops testing systemsthinking noahsussman an illustration of the funnel for foss img src https 64 media tumblr com 36514efcc3f4fd92972d0af60d6b7cb9 tumblr_orjiyqtbla1rswam8o1_500 jpg br br p p p an illustration of the funnel for foss developer engagement p https infiniteundo com post 161813978333 https infiniteundo com post 161813978333 wed 14 jun 2017 10 01 38 0400 devops pyramid testing foss madewithpaper noahsussman miller is like jq for csv and other tabular data p img src http i imgur com ofzuwdal png title photo by blavandmaster on flickr p hr blockquote p a href https github com johnkerl miller title miller a is like awk sed cut join and sort for name indexed data such as csv tsv and tabular json p blockquote h2 here s how i use miller to pipe csv data into code jq code h2 p a href http infiniteundo com post 158798797433 practical jq title jq is like sed for json data you can use it to slice and filter and map and transform structured data with the same ease that sed awk grep and friends let you play with text code jq code a is currently my tool of choice when it comes to processing all sorts of data except xml and csv xml is pretty well handled by a href http freesoftwaremagazine com articles xml_starlet title xmlstarlet a unix toolkit for xml code xmlstarlet code a but i have never found a csv parsing tool that i liked i just make do with a href http infiniteundo com post 99336704013 convert csv to json with jq using code jq code to work with csv a and to be honest i find the results i can achieve to be substandard p p anyway miller solves all that and is easy to install even if you don t use homebrew and need to compile it from source p pre code mlr c2j cat my_file csv jq code pre p it is that easy now my csv is structured as json which i have spent a lot of time learning to enjoy working with in code jq code p https infiniteundo com post 161741983358 https infiniteundo com post 161741983358 mon 12 jun 2017 13 47 35 0400 jq json xml csv data parsing bash commandline github free open source noahsussman concern troll rationalwiki a href http rationalwiki org wiki concern_troll concern troll rationalwiki a p a href http rationalwiki org wiki concern_troll class image img alt src http sjwiki org images thumb 8 85 concern_troll jpg 300px concern_troll jpg width 300 height 560 class thumbimage hoverzoomlink a p hr h2 testing vs checking h2 p strong testing vs checking strong p p you will find this meme under discussion at all of the leading software quality assurance sqa conferences today including strong gtac stpcon star cast and the various selenium confs strong p p in short the discussion revolves around whether a a href post 141887918393 is testing vs checking just cartesian dualism cartesian divide a can be effected between the human and the computer s role in software quality assurance p blockquote p testing vs checking p blockquote p it is not the discussion itself that bothers me although cartesian division is out of fashion with devops luminaries such as myself i can certainly see the utility of a cartesian point of view when establishing certain foundational local taxa as we test architects often must do p h2 concern trolling h2 p what jerks my a href http infiniteundo com post 146651832083 open letter to software testers fucking a chain though is the god damned concern trolling p p the biggest problem by far is all the fucking language policing that goes on in the testing and in the agile community language policing is microagressions stop it and apologize p p the a href http www softwaretestingclub com forum topics do we need to talk about automation title do we need to talk about automation software testing club an online software testing community most common form a of language policing aka tone policing that i ve seen take place around strong testing vs checking strong is correcting people who choose to identify as automators of test activities p p i ve personally been interrupted em while speaking at a conference em at least em three em times only to have the interruptor explain that checking isn t testing yeah motherfucker i already knew that and i don t give a shit about it becasue from my perspective that s minutia that everyone takes as written in the first place p p interrupting other professionals to corret trivial language choices is uncool at best viewed in a dispassionate light such behavior is elitist immature and alienating most people won t put up with that either because it makes them feel bad or because it makes them feel like they ve wasted their time yet the behavior persists a href https medium com marlenac the blood bag co narcissists and narcissists in tech b6c78ae2aa5e for some reason a p https infiniteundo com post 161716045283 https infiniteundo com post 161716045283 sun 11 jun 2017 20 55 57 0400 testing testing vs checking quality assurance etsy software quality assurance codeascraft noahsussman a modern vision of testing as sympoietic development praxis p a class twitter moment href https twitter com i moments 871415119082926081 a modern vision of testing as sympoietic development praxis a script async src platform twitter com widgets js charset utf 8 script p https infiniteundo com post 161432499348 https infiniteundo com post 161432499348 sun 04 jun 2017 13 24 43 0400 testing devops software quality assurance noahsussman software testing considered as a series of band pass img src https 64 media tumblr com b04dd4676f785f187b74ff5b96ffcce0 tumblr_oqvtbixtkh1rswam8o1_500 png br br img src https 64 media tumblr com f4fe4456b828a4cd2a4f11955da3cbf7 tumblr_oqvtbixtkh1rswam8o2_500 jpg br br h2 software testing considered as a series of band pass filters h2 p these are a pair of slides from a talk i am currently developing p https infiniteundo com post 161323522783 https infiniteundo com post 161323522783 thu 01 jun 2017 14 42 54 0400 devops testing noahsussman teleonomy and the quality without a name qwan p good systems converge on quality they snap back into shape when deformed autoscaling is an example of how web systems regain their good state after some event has impacted functionality p p bad systems act the same when pushed toward a better state they gradually edge back toward the bad state take for example the familiar case of a legacy system that has been put under test but gradually edges back toward untestedness again p p teleonomy confirms what we intuitively already know that some systems are easy to collaborate with and that other systems seem adversarial in our interactions with them p p the principle of teleonomy shows that intent is not required in order for a system to pursue a goal neither collaboration nor antagonism requires intent p p a href http infiniteundo com post 161212025908 the timeless way of building chapter 2 the alexander is very clear in defining qwan a good systems pursue the goal of inner consistency bad systems pursue a state of internal conflict when humans pursue a goal of internal consistency then we are pursuing the same goal as a well functioning complex system that the goals are aligned is sufficient to say that human and computer are collaborating intent is not required the observed state of alignment qualifies fully as collaboration p p the snapping back into shape of complex systems is a practical example of system memory one of the defining characteristics of a complex system as opposed to a simple one memory is also a characteristic of cellular automata such as the a href http nautil us issue 23 dominoes the amazing autotuning sandpile title the amazing autotuning sandpiles show remarkably complex behavior abelian sandpile model a p p so computers can be seen without resorting to metaphor as collaborating agents that not only have goals for the future but also remember the past this is the observed reality of working on the computer system it is difficult not to eventually regard computer systems as having motivations and goals which do not always align with our own teleonomy and sympoiesis are lenses through which this observed reality makes sense p p dijkstra once said that the metaphor of the bug that crept in while the programmer wasn t looking is intellectually dishonest because any bug in the system must have originally been put there by a programmer but teleonomy implies sympoiesis between human and program and that in turn calls dijkstra s statement into question p p bugs and features and everything in between do not originate with a human agent instead the characteristics of the system are defined in the collaborat...
|
