Meta tags:
Headings (most frequently used words):
parallel, create, socket, cluster, makecluster, description, usage, arguments, details, value, note, author, package, documentation, browse, packages, we, want, your, feedback,
Text of the page (most frequently used words):
the (79), for (26), and (21), cluster (21), workers (15), #parallel (13), default (13), master (11), this (9), socket (9), worker (9), are (9), package (8), host (8), that (7), unix (7), process (7), makecluster (7), rscript (7), will (7), which (7), packages (6), run (6), set (6), true (6), see (6), other (5), using (5), create (5), number (5), running (5), path (5), homogeneous (5), same (5), not (5), all (5), null (5), details (5), port (5), may (5), type (5), code (4), your (4), note (4), can (4), documentation (4), windows (4), function (4), forking (4), current (4), clusters (4), false (4), creates (4), options (4), with (4), makeforkcluster (4), only (4), logical (4), supported (4), makepsockcluster (4), its (3), versions (3), vector (3), fork (3), cpu (3), from (3), snow (3), each (3), option (3), defaults (3), one (3), setdefaultcluster (3), use (3), timeout (3), character (3), started (3), when (3), local (3), machine (3), time (3), name (3), seconds (3), before (3), known (3), types (3), names (3), copies (3), more (2), embedding (2), copy (2), website (2), github (2), support (2), should (2), language (2), rdrr (2), home (2), improve (2), page (2), find (2), what (2), mclapply (2), pvec (2), evaluate (2), mcfork (2), low (2), forked (2), processes (2), detect (2), cores (2), core (2), author (2), usage (2), multi (2), appropriate (2), required (2), version (2), was (2), registered (2), such (2), object (2), class (2), session (2), stopcluster (2), usexdr (2), outfile (2), setup_strategy (2), manual (2), psock (2), where (2), nodes (2), communication (2), methods (2), need (2), user (2), communicating (2), another (2), arguments (2), connection (2), file (2), maximum (2), failing (2), days (2), calls (2), passed (2), nnodes (2), spec (2), close, information, customizing, embed, read, snippets, clipboard, remove, add, following, snippet, personal, blog, ian, mutexlabs, com, issue, tracker, tweet, rdrrhq, provide, technical, individual, you, contact, authors, want, feedback, forge, bioconductor, cran, browse, online, submit, extra, info, optional, have, suggestion, looking, content, looks, wrong, serial, mcmapply, mcdummies, parallelize, map, expression, asynchronously, separate, mcparallel, lapply, mapply, get, affinity, mask, mcaffinity, level, functions, management, children, divide, tasks, distribution, splitindices, implementation, pierre, ecuyer, rngstreams, rngstream, computation, detectcores, apply, operations, clusterapply, derived, luke, tierney, very, common, both, single, settings, ones, found, their, shell, interpretation, launched, given, full, nor, even, years, documented, hosts, identical, setups, but, apparently, restrictive, than, intended, setter, getter, there, creators, sockcluster, value, registers, removes, does, stopping, good, practice, shut, down, calling, however, terminate, themselves, once, they, listening, commands, becomes, unavailable, completed, dies, hence, available, supports, always, uses, gui, front, ends, threaded, libraries, strongly, discouraged, during, setup, possible, now, automatically, sequentially, older, expert, debugging, removed, future, sequential, serialization, xdr, large, amounts, data, transferred, little, endian, substantially, faster, load, loading, saves, startup, manually, used, command, launch, ssh, rshcmd, numerical, niceness, priority, dependent, psnice, renice, additional, environ, rscript_args, direct, output, indicates, redirection, useful, possibility, files, opened, append, mode, log, nul, dev, stderr, stdout, attempts, connect, minutes, waiting, next, attempt, starts, incremented, after, retry, setup_timeout, zero, between, posix, standard, requires, values, taken, environment, variable, then, randomly, chosen, range, 11000, 11999, r_parallel_port, private, subnets, necessary, specify, numeric, address, example, macos, likely, itself, somename, several, mainly, most, often, merely, stub, alike, platforms, enhanced, runs, specified, listens, expressions, returns, results, serialized, objects, makesockcluster, spawning, either, positive, integer, case, localhost, specification, getoption, getdefaultcluster, over, sockets, description, browser, docs,
Text of the page (random words):
makecluster create a parallel socket cluster rdrr io find an r package r language docs run r in your browser home r documentation parallel makecluster create a parallel socket cluster makecluster create a parallel socket cluster makecluster r documentation create a parallel socket cluster description creates a set of copies of r running in parallel and communicating over sockets usage makecluster spec type makepsockcluster names makeforkcluster nnodes getoption mc cores 2l stopcluster cl null setdefaultcluster cl null getdefaultcluster arguments spec a specification appropriate to the type of cluster names either a character vector of host names on which to run the worker copies of r or a positive integer in which case that number of copies is run on localhost nnodes the number of nodes to be forked type one of the supported types see details options to be passed to the function spawning the workers see details cl an object of class cluster details makecluster creates a cluster of one of the supported types the default type psock calls makepsockcluster type fork calls makeforkcluster other types are passed to package snow makepsockcluster is an enhanced version of makesockcluster in package snow it runs rscript on the specified host s to set up a worker process which listens on a socket for expressions to evaluate and returns the results as serialized objects makeforkcluster is merely a stub on windows on unix alike platforms it creates the worker process by forking the workers are most often running on the same host as the master when no options need be set several options are supported mainly for makepsockcluster master the host name of the master as known to the workers this may not be the same as it is known to the master and on private subnets it may be necessary to specify this as a numeric ip address for example macos is likely to detect a machine as somename local a name known only to itself port the port number for the socket connection default taken from the environment variable r_parallel_port then a randomly chosen port in the range 11000 11999 timeout the timeout in seconds for that port this is the maximum time of zero communication between master and worker before failing default is 30 days and the posix standard only requires values up to 31 days to be supported setup_timeout the maximum number of seconds a worker attempts to connect to master before failing default is 2 minutes the waiting time before the next attempt starts at 0 1 seconds and is incremented 50 after each retry outfile where to direct the stdout and stderr connection output from the workers indicates no redirection which may only be useful for workers on the local machine defaults to dev null nul on windows the other possibility is a file path on the worker s host files will be opened in append mode as all workers log to the same file homogeneous logical default true see note rscript see note rscript_args character vector of additional arguments for rscript such as no environ renice a numerical niceness to set for the worker processes e g 15 for a low priority os dependent see psnice for details rshcmd the command to be run on the master to launch a process on another host defaults to ssh user the user name to be used when communicating with another host manual logical if true the workers will need to be run manually methods logical if true default the workers will load the methods package not loading it saves ca 30 of the startup cpu time of the cluster usexdr logical if true default serialization will use xdr where large amounts of data are to be transferred and all the nodes are little endian communication may be substantially faster if this is set to false setup_strategy character if parallel default workers will be started in parallel during cluster setup when this is possible which is now for homogeneous psock clusters with all workers started automatically manual false on the local machine workers will be started sequentially on other clusters on all clusters with setup_strategy sequential and on r 3 6 0 and older this option is for expert use only e g debugging and may be removed in future versions of r function makeforkcluster creates a socket cluster by forking and hence is not available on windows it supports options port timeout and outfile and always uses usexdr false it is strongly discouraged to use the fork cluster with gui front ends or multi threaded libraries see mcfork for details it is good practice to shut down the workers by calling stopcluster however the workers will terminate themselves once the socket on which they are listening for commands becomes unavailable which it should if the master r session is completed or its process dies function setdefaultcluster registers a cluster as the default one for the current session using setdefaultcluster null removes the registered cluster as does stopping that cluster value for the cluster creators an object of class c sockcluster cluster for the default cluster setter and getter the registered default cluster or null if there is no such cluster note option homogeneous true was for years documented as are all the hosts running identical setups but this was apparently more restrictive than its author intended and not required by the code the current interpretation of homogeneous true is that rscript can be launched using the same path on each worker that path is given by the option rscript and defaults to the full path to rscript on the master the workers are not required to be running the same version of r as the master nor even as each other for homogeneous false rscript on the workers is found on their default shell s path for the very common usage of running both master and worker on a single multi core host the default settings are the appropriate ones author s luke tierney and r core derived from the snow package parallel clusterapply apply operations using clusters detectcores detect the number of cpu cores makecluster create a parallel socket cluster parallel package support for parallel computation rngstream implementation of pierre l ecuyer s rngstreams splitindices divide tasks for distribution in a cluster unix children low level functions for management of forked processes unix mcaffinity get or set cpu affinity mask of the current process unix mcfork fork a copy of the current r process unix mclapply parallel versions of lapply and mapply using forking unix mcparallel evaluate an r expression asynchronously in a separate process unix pvec parallelize a vector map function using forking windows mcdummies serial versions of mclapply mcmapply and pvec what can we improve the page or its content looks wrong i can t find what i m looking for i have a suggestion other extra info optional submit improve this page r package documentation rdrr io home r language documentation run r code online browse r packages cran packages bioconductor packages r forge packages github packages we want your feedback note that we can t provide technical support on individual packages you should contact the package authors for that tweet to rdrrhq github issue tracker ian mutexlabs com personal blog embedding an r snippet on your website add the following code to your website remove this copy to clipboard for more information on customizing the embed code read embedding snippets close
|