Meta tags:
description=Webarchitects Co-operative systems and server status news and updates.;

Headings (most frequently used words):

0100, 0000, wed, 09, thu, 10, fri, 20, 2020, 08, sat, 2024, 11, 19, tue, 21, 16, 18, jul, 12, 2023, 22, 2021, 2025, mon, 17, 2022, 13, 15, 14, 23, 2026, jan, oct, 06, apr, sun, 07, aug, mar, feb, nov, sep, may, 24, 05, 04, 01, 30, 29, jun, 03, 28, 26, 31, dec, 02, 25, 2017, 2019, 27, 00, 2018, 41, 58, 53, 59, 45, 54, 47, 55, 56, 35, 40, 39, 52, 50, 37, 48, 46, 34, 32, 36, 49, 44, 57, 42, 33, 43, 38, 51, 2016, webarchitects, service, status,

Text of the page (most frequently used words):
are (1094), the (1020), will (850), for (826), this (678), 0100 (676), and (599), upgrading (562), little (510), servers (468), unavailable (454), while (442), all (441), 0000 (441), result (398), gitlab (382), coop (340), our (319), git (306), webarch (289), docker (287), services (277), that (261), mailcow (244), wed (234), version (233), email (225), being (223), discourse (223), server (216), downtime (203), thu (180), fri (176), 2024 (176), have (168), 2020 (168), sat (160), tue (148), sorry (144), 2023 (144), update (143), 2025 (135), 2022 (132), jul (130), 2021 (128), mon (124), 2026 (118), restarted (118), run (116), release (110), service (108), containers (107), with (103), running (102), cause (101), oct (101), jan (101), has (98), some (98), apr (98), net (97), sun (96), now (95), apply (95), nov (92), feb (92), aug (92), mar (92), minutes (91), sep (91), may (90), hosted (87), again (86), security (85), been (83), debian (78), disk (74), jun (74), instances (73), upgrade (72), down (70), updating (68), dec (68), around (64), from (63), 2017 (63), patch (63), issue (61), they (61), there (57), 2019 (57), mail (56), caused (55), additional (55), issues (54), should (52), any (51), new (51), linux (51), 2018 (49), space (48), offline (47), completed (47), virtual (46), bookworm (46), very (45), sheffield (44), going (44), about (43), few (43), shutting (43), these (41), back (41), sites (39), data (38), including (38), updates (37), add (37), nextcloud (37), onlyoffice (37), inconvenience (36), was (36), working (34), centre (34), reboot (33), one (32), but (32), rebooted (31), rebooting (30), time (29), take (29), latest (29), not (28), them (28), shutdown (28), host (28), restarting (27), webarch6 (27), problem (26), which (26), available (26), soon (26), morning (26), hours (25), also (25), shared (25), more (25), containerd (25), hosting (24), resolved (24), specifically (24), install (24), file (23), host3 (23), hope (23), work (23), like (23), having (22), out (22), webarchitects (21), other (21), currently (21), please (21), webarch1 (21), adding (21), bullseye (21), ecohost (20), just (20), problems (20), kernel (20), webarch4 (20), require (20), can (19), today (19), 2016 (19), connectivity (19), need (19), due (19), therefore (19), webarch2 (19), array (19), includes (19), dsa (19), you (18), had (18), critical (18), believe (17), bst (17), ram (17), use (17), two (17), disks (17), webarch7 (17), when (16), mail1 (16), once (16), order (16), over (16), during (16), moment (16), before (16), starting (16), address (16), updated (16), minute (16), xen4 (16), instance (16), another (15), hour (15), sogo (15), restart (15), power (15), between (14), several (14), hosts (14), see (14), still (14), wil (14), site (13), network (13), investigating (13), outage (13), process (13), might (13), router (13), next (13), long (13), based (12), say (12), move (12), yet (12), host2 (12), shouldn (12), last (12), evening (12), such (12), amd64 (12), trixie (12), dns (11), main (11), restored (11), short (11), across (11), maintenance (11), lost (11), doing (11), only (11), than (11), webarch5 (11), fix (11), addition (11), revision (11), contact (10), check (10), your (10), via (10), start (10), means (10), expect (10), upgraded (10), anticipate (10), using (10), appears (10), everything (10), depend (10), image (10), rspamd (10), fixes (10), don (9), able (9), chat (9), iceland (9), post (9), then (9), users (9), office (9), into (9), bringing (9), afraid (9), won (9), bring (9), get (9), webarch3 (9), php (9), runner (9), support (8), status (8), infrastructure (8), web (8), after (8), looking (8), interface (8), system (8), account (8), used (8), spam (8), afternoon (8), were (8), physical (8), planned (8), mailman (8), complete (8), following (8), results (8), domain (8), old (8), settings (8), storage (8), mariadb (8), extend (8), moving (8), machine (7), line (7), shortly (7), each (7), systems (7), xen1 (7), aware (7), solve (7), rate (7), longer (7), front (7), facing (7), night (7), point (7), however (7), applying (7), off (7), certificate (7), place (7), delayed (7), failure (7), attack (7), access (7), related (7), managed (7), upgarding (7), dokcer (7), ensure (6), found (6), emails (6), without (6), delivery (6), removed (6), large (6), what (6), multiple (6), online (6), stopped (6), migrating (6), copying (6), copied (6), probably (6), way (6), appear (6), mysql (6), fully (6), migration (6), resources (6), replacement (6), tonight (6), installing (6), clients (6), configuration (6), upgrades (6), unavilable (6), periods (6), most (6), tomorrow (6), mooly (6), beta2 (6), times (5), info (5), lists (5), blacklists (5), days (5), know (5), mkdoc (5), compromised (5), send (5), sent (5), appologise (5), essential (5), let (5), 10pm (5), their (5), planning (5), possible (5), accounts (5), investigate (5), resolve (5), taking (5), normal (5), effect (5), limiting (5), couple (5), package (5), ssd (5), expected (5), sunday (5), resulted (5), requires (5), include (5), beta5 (5), beta3 (5), moopril (5), mooay (5), ssh (5), matomo (5), notes (5), webarch8 (5), xen5 (5), operative (4), response (4), help (4), jobs (4), page (4), libera (4), causing (4), barracuda (4), blocked (4), blacklist (4), here (4), removing (4), until (4), phone (4), load (4), host1 (4), under (4), high (4), number (4), apart (4), backup (4), july (4), normally (4), progresses (4), hardware (4), come (4), moved (4), partition (4), fixed (4), done (4), filesystem (4), january (4), xen2 (4), rebuilt (4), added (4), started (4), full (4), try (4), quick (4), name (4), 8pm (4), needed (4), day (4), took (4), upstream (4), example (4), brought (4), postgresql (4), disruption (4), migrate (4), forum (4), prior (4), inconvience (4), forums (4), less (4), different (4), set (4), others (4), hopefully (4), restarts (4), beta4 (4), important (4), seconds (4), bug (4), fingerprints (4), sidebar (4), improvements (4), api (4), moovember (4), container (4), touch (4), october (4), applied (4), contains (4), 18th (4), beta1 (4), reboots (4), dovecot (4), mailbox (4), cooperative (4), ashton (4), limited (3), policy (3), abuse (3), provided (3), announcement (3), irc (3), listed (3), reputation (3), delisted (3), discovered (3), queue (3), outgoing (3), volume (3), secure (3), removal (3), loss (3), error (3), quite (3), encrypt (3), https (3), maintainance (3), resulting (3), impact (3), blacklisted (3), requested (3), org (3), boot (3), doesn (3), asap (3), solved (3), making (3), restore (3), vps (3), affected (3), vulnerabilities (3), connecting (3), connection (3), apache (3), rebuilding (3), ones (3), dns0 (3), many (3), search (3), applications (3), temporary (3), solution (3), bandwidth (3), would (3), intend (3), enable (3), enabled (3), datacentre (3), quickly (3), suffering (3), put (3), ddos (3), against (3), idea (3), reason (3), because (3), total (3), mornings (3), extending (3), size (3), degraded (3), performance (3), much (3), copy (3), weekend (3), buster (3), switch (3), reconfiguration (3), unavalable (3), within (3), overnight (3), changes (3), details (3), beta6 (3), upgradig (3), sending (3), openssh (3), mootember (3), mistake (3), mooctober (3), yesterday (3), upgradimg (3), made (3), monitoring (3), current (3), nature (3), published (3), earlier (3), moocember (3), littlw (3), conteiners (3), platform (3), avensys (3), lyne (3), almost (3), v2026 (3), deb13 (3), 276 (2), 9709 (2), documentation (2), code (2), script (2), takes (2), outstanding (2), recent (2), internet (2), public (2), tracked (2), request (2), delisting (2), experiencing (2), mailserver (2), delays (2), devices (2), happened (2), occur (2), fault (2), seeing (2), ticketing (2), period (2), recieved (2), returned (2), sender (2), payments (2), paypal (2), correctly (2), went (2), 20am (2), 30am (2), checked (2), interuption (2), restoring (2), 2am (2), sorbs (2), runs (2), room (2), fail (2), repair (2), enough (2), cat (2), 275g (2), london (2), location (2), functional (2), 1984ehf (2), since (2), lot (2), find (2), wednesday (2), amount (2), ipmi (2), hasn (2), delay (2), dns1 (2), anti (2), week (2), growing (2), client (2), part (2), haven (2), sevices (2), could (2), solr (2), searching (2), nights (2), variety (2), key (2), effecting (2), checking (2), cpus (2), gmt (2), failed (2), 10am (2), configuring (2), further (2), source (2), replacing (2), better (2), tls (2), people (2), did (2), upgading (2), change (2), whole (2), ups (2), rack (2), end (2), didn (2), allow (2), decrypting (2), first (2), mitigations (2), reflection (2), provider (2), ntp (2), prevent (2), triggered (2), who (2), lifted (2), gone (2), booting (2), inconvienience (2), utc (2), released (2), depends (2), stopping (2), needs (2), upgradeing (2), members (2), shall (2), situation (2), reconfiguring (2), user (2), fpm (2), registry (2), happening (2), ehlo (2), helo (2), fact (2), capacity (2), expand (2), grow (2), sometime (2), 6pm (2), cloudmark (2), improve (2), note (2), happen (2), older (2), upgrdaing (2), execution (2), upgradng (2), tasks (2), either (2), sharenergy (2), holyoake (2), cloud (2), leedsbread (2), animorph (2), memory (2), requests (2), ssl_cert_dir (2), ssl (2), additinal (2), moorch (2), adjusting (2), moone (2), beta7 (2), redis (2), beta8 (2), beta9 (2), moments (2), amoogust (2), kernal (2), increase (2), dedicated (2), smtp (2), versions (2), project (2), quarantine (2), menu (2), getting (2), yesterdays (2), scopes (2), installed (2), delivered (2), allpy (2), downgrading (2), wysiwyg (2), editor (2), document (2), rolled (2), taken (2), report (2), thread (2), denial (2), straight (2), away (2), units (2), turn (2), core (2), failures (2), addresses (2), same (2), microcode (2), 5462 (2), 5461 (2), networking (2), addressed (2), information (2), postfix (2), additonal (2), hotfix (2), deploy (2), repo (2), 8th (2), machines (2), missing (2), switching (2), footer (2), nftables (2), onlyoffice2 (2), onlyoffice1 (2), editing (2), mobile (2), redesign (2), admin (2), 01a (2), default (2), warning (2), unbound (2), febmooary (2), cpu (2), vulnerability (2), involves (2), documentserver (2), later (2), imap (2), numbers (2), minimal (2), linuk (2), thus (2), packages (2), stack (2), raised (2), reminder (2), appreciate (2), understanding (2), too (2), unexpected (2), pre (2), carrying (2), kernels (2), wordpress (2), registration, 31305r, 4qu, 68a, john, street, 114, sitemap, privacy, complaints, totally, independently, outages, elsewhere, affect, regenerated, committed, html, gandi, view, snapshot, archive, archives, browse, relay, launched, poor, requesting, progrees, debouncer, 108, wait, blocklist, evaluated, responded, follows, networks, fewer, extra, bear, clears, echost, cleared, explain, automatic, ips, seen, clean, best, answerphone, nobody, accepting, tickets, christmas, year, misconfiguration, tried, resend, original, undelivered, invoices, invoice, expanding, spike, sincererly, labour, mps, web2, certificates, oscp, conduct, involve, 5th, possibility, negative, regarding, listings, xen3, trying, gitosis, domains, centos, uptime, chips, rescue, raid, partitions, freebds, zfs, 41g, webserver, 90g, 30pm, spoken, xen, plased, veryr, completes, pleased, pleaase, 1984, spending, team, experts, field, costly, setup, deemed, fit, scrap, distant, 1984efh, news, backups, ecodis, restoration, hopeful, lastest, ago, thought, nearly, corrupt, beyond, vpss, retrieve, every, customers, mailboxes, announcing, expecting, course, 10th, great, meltdown, spectre, exploit, shut, ready, loads, european, paris, icelandic, 185, 112, 146, dns3, 217, 190, 127, dns2, uggrading, ten, article, background, huge, volumes, detail, resizing, massive, secured, seeking, intermittent, slow, speeds, iowait, non, rescan, returning, sets, scan, facility, disable, index, works, slower, bios, sever, booted, giving, inadequate, second, testing, sufficient, provision, pair, replacements, usual, incoming, interruptions, 50pm, ever, lapsing, renewed, generated, undertaken, unsure, wioll, 2pm, area, batteries, month, manage, provide, generator, well, decade, partners, looks, mitigating, disrupting, matter, case, gmail, outlook, passwords, strong, outside, waiting, member, staff, responding, console, cycling, mount, leaving, remaining, remotly, innodb, recovery, things, already, uugrading, manually, unavailble, updadet, allocated, upavailable, production, scheduled, cancelled, earlire, weeks, four, stable, regenerating, config, mod_php, 11pm, both, uogading, autoreply, messages, restaring, arranging, visit, powered, runnning, resolves, doubled, 20gib, 40gib, reflects, how, usage, advice, successfully, kate, projects, sorting, correct, developer, through, checks, 1tb, emal, 1tib, operational, lasting, extended, gateway, upgradinmg, dhh, half, containing, offiline, faster, biggest, 200g, transfer, sizes, intelligence, csi, rbl, listing, reset, instantly, generally, receiving, unavailabe, computer, errors, action, mounting, effected, three, look, backlog, servics, discorse, sieve, filters, ina, mostly, fairly, configurations, finished, functioning, leak, misconfiguraton, fixing, mediawiki, willtle, where, print, message, near, future, 23t11, 48z, level, msg, configured, opt, embedded, certs, commit, pull, crashed, recovering, allocations, hardly, interruption, cve, 24769, minutues, wthey, composer, reult, tfa, flow, potentially, memcache, quotas, syste, clock, uograding, debial, resterted, killer, 26gib, 30gib, aim, oom, reported, nightly, build, comes, low, severity, minor, compose, buildx, runcm, generating, swagger, beta10, notification, accidentially, pyhsical, availablity, bottom, loading, documents, v20, solving, relased, stability, beta11, general, category, beta12, conteners, dicsourse, policies, variables, dast, beta13, beta14, import, tracking, lttle, minimise, recieving, rectified, catch, retried, beta15, beta16, upgrdading, broken, docs, onlyofice, snapshots, versio, discaouse, disabled, suggetsed, mitigate, tis, someone, unscheduled, happy, measures, mitirgate, detected, 21st, heard, portable, unitis, simultaneous, rapid, temperature, hang, face, attempt, brute, force, logins, max, reasonable, mooai, unvailable, containerst, 26th, manageable, cors, 30th, 07a, gtlab, informed, followed, accessible, locations, addressing, test, http, content, header, shhutting, september, pass, rsa, keys, 4096, bits, locally, audit, 9pm, preperation, reduced, nex, six, pdates, servershad, extension, binaries, sury, synchronization, wide, netfilter, banlist, endpoint, ran, unaffected, easier, threads, experimental, janmooary, multiarch, x86, arm64, 01b, groups, dms, passkeys, dokce, specfically, 01c, contaoners, 01e, removes, ships, hide, ckeditor, servives, provides, docuemnt, hub, suffereing, lack, 000, relating, srvices, cores, meantime, accesed, sub, valid, subjectaltnames, cert, engineer, cross, scriping, arbitrary, monday, april, bookwork, 5680, 5681, 5682, glib2, runnng, reseult, instaces, brief, momentarily, happens, flatcurve, phase, debiab, 31st, unaviodable, detailed, adresses, internal, theis, knock, notified, starts, systemd, ormally, impacts, even, though, does, read, follow, 5747, announced, 08a, hot, top, items, feature, indicator, polls, show, absolute, updaing, releases, srvers, mode, 5782, eleven, suffered, runners, implemented, rename, 11a, 11b, 5818, ceasing, websites, 5860, per, unavoidable, swap, oriole, downgrade, iptables, hit, upgradesing, din, external, indicates, lasted, sercurity, utils, liblzma5, occured, 27am, connectionm, traffic, route, path, docket, contaners, 5907, identified, restrictions, deleted, depending, 5925, webmail, adminstration, login, url, domainadmin, good, needing, confirmed, ansible, configures, runin, cooop, resut, plan, tiny, bit, ignored, developers, rotate, personal, token, 6009, posted, patience, step, toward, resilient, complexity, 19th, relocated, marks, exciting, opportunity, resilience, strengthen, connections, cooperatives, building, truly, cni, years, unfortunately, closing, relocate, equipment, upgradog, powering, racks, below, everyting, sort, 10a, mean, required, 6053, runniong, restated, why, database, mignight, closely, usually, late, stop, v29, eas, dav, restricted, alias, trixies, 6126, 6127, resolution, resolving, cron, failing, chroots, chroot, etc, resolv, conf, saturday, march, temporarily, apologise, prune, unused, small, docuum, substantial, forced, 2fa, supply, supplies, far, miuntes, 25am, 40am, 03b, 6243, bookwrom, major, majority, 6295, 174, crawlers, respect, recently, disallow, robots, txt, bot, least, upgradingt, unavialable, 177, wp2shell, authentication, rce, nginx, 100, minuted, intended, thanks, 101, 07b, channel, 0114, sustainable,

Text of the page (random words):
may 2020 08 25 14 0100 this mornings upgrades have completed in a little while webarch email should have fully restarted all other services should already be up and running without issues fri 15 may 2020 07 55 15 0100 we are about to update the docker containerd io package on all our servers this will cause all the services running via docker to be restarted so there will be some downtime for some things like webarch email for a little while thu 14 may 2020 15 31 20 0100 we are about to upgrade git coop so it will be down for a little while mon 04 may 2020 19 05 18 0100 we are upgrading gitlab on git coop thu 30 apr 2020 21 07 46 0100 we are upgrading gitlab on git coop sun 26 apr 2020 09 21 55 0100 we are sorry that the apache web server stopped running on webarch3 co uk just before 1 20am bst this morning we haven t found the cause of this but the service was restored at 9 10am sat 25 apr 2020 20 53 24 0100 we are rebooting webarch6 co uk to add additional cpus to the server it will be unavailable for a little while fri 24 apr 2020 14 04 33 0100 we are upgrading gitlab on git coop it will be unavailable for a little while thu 23 apr 2020 22 54 49 0100 we are upgrading webarch email it will be unavailable for a little while wed 22 apr 2020 16 27 56 0100 we are upgrading gitlab on git coop so it will be unavailable for a little while mon 20 apr 2020 11 17 05 0100 we are upgrading gitlab on git coop so it will be offline to a little time fri 17 apr 2020 22 19 00 0100 we are going to be upgrading webarch email shortly and this will result in it being unavailable for a little while wed 15 apr 2020 07 58 38 0100 we are upgrading gitlab on git coop it will be unavailable for a little while wed 01 apr 2020 07 20 35 0000 we are upgrading gitlab on git coop it will be unavailable for a little while sun 29 mar 2020 10 53 07 0100 we are going to upgrade webarch email so it will be unavailable for a little while from around 11 00 utc sat 28 mar 2020 23 22 23 0000 the webarch6 co uk server is up now we are very sorry for the downtime of services today sat 28 mar 2020 20 37 06 0000 we believe that all our servers are now back up apart from webarch6 co uk we are still working on this one please contact us at support webarchitects coop if you are having an issue with a service not on webarch6 co uk sat 28 mar 2020 19 12 46 0000 we are having issues with mariadb innodb recovery on several shared hosting servers sat 28 mar 2020 18 09 28 0000 we are now leaving the data centre we will bring up the remaining servers remotly sat 28 mar 2020 18 06 14 0000 we have started bringing up the virtual servers it will be a little while before they are all running again sat 28 mar 2020 17 48 39 0000 there appears to be no hardware problem with the file server we are now decrypting the disks and bringing it back up once this has been done we will be able to mount the filesystem from the front facing servers and then we will be able to start bringing all the virtual servers back up this is going to probably take a couple of hours in total very sorry for the inconvienience caused sat 28 mar 2020 17 40 31 0000 our main file server is still booting sat 28 mar 2020 17 15 29 0000 our main file server was not responding on the console so we are power cycling it it is booting now we will need to restart all the virtual servers after the file server is brought back up sat 28 mar 2020 16 47 41 0000 we are outside our sheffield data centre waiting for a member of staff to let us in sat 28 mar 2020 16 30 01 0000 our main file server had gone down and we are on our way to the data centre to investigate the cause sat 28 mar 2020 15 57 13 0000 we are having some issues with our infrastructure in sheffield and are investigating the cause thu 26 mar 2020 18 02 54 0000 we are updating gitlab on git coop so it will be unavailable for a little while sun 22 mar 2020 14 36 04 0000 we are upgrading gitlab on git coop so it will be unavailable for a little while tue 17 mar 2020 07 36 01 0000 we are upgrading gitlab on git coop so it will be down for a little while mon 16 mar 2020 15 24 14 0000 we are aware of rate limiting of email from webarch email to gmail and outlook we believe that this has been triggered by a client who s email account was compromised and then used to send a large volume of spam please ensure that all the devices that you use to access your email accounts are secure and that all your email passwords are strong ones we expect the rate limiting to be lifted in time sun 15 mar 2020 13 46 59 0000 we are shutting down webarch email to add additional disk space it will be unavailable for a little while wed 11 mar 2020 23 21 11 0000 we are upgrading gitlab so git coop will be unavailable for a little while wed 11 mar 2020 20 36 01 0000 we are upgrading docker on all our servers this will case a little downtime for servers that use docker like webarch email mon 09 mar 2020 09 12 17 0000 we are upgrading gitlab on git coop it will be unavailable for a little while wed 04 mar 2020 06 30 04 0000 we are upgrade docker on all our servers this will result in a little downtime on webarch email tue 03 mar 2020 06 51 48 0000 we are updating docker on all our servers this will result in a little downtime on servers that use docker for example webarch email fri 21 feb 2020 20 03 00 0000 we are upgrading webarch email so it will be unavailable for a little while mon 17 feb 2020 20 37 01 0000 we are rebooting host3 webarch net and it is currently doing a file system check it should be back online soon sorry for any inconvenience caused thu 13 feb 2020 19 05 26 0000 our upstream bandwidth provider had put mitigations in place to prevent the ntp reflection attack from disrupting our services we hope this this is the end of the matter however because we still have no idea what the reason for the attack was we have no idea if there is more to come once again we are very sorry for any inconvenience caused thu 13 feb 2020 18 09 31 0000 it looks like it is a ntp reflection attack against webarch4 co uk we have no idea of the reason for it our upstream bandwidth provider is working on mitigating the effect thu 13 feb 2020 17 33 29 0000 our sheffield network is suffering from a ddos we are working with our upstream partners to investigate the cause of this and to see what mitigations can be put in place we are very sorry for any inconvenience caused wed 12 feb 2020 22 24 34 0000 we need to quickly reboot webarch6 co uk sorry that it would be available for a few minutes sat 08 feb 2020 15 08 00 0000 we believe that all systems are up and running now there was a power outage for the whole area that our data centre is in and then the ups for our rack which is due to have replacement batteries by the end of the month didn t manage to provide power for quite long enough to allow the backup generator to start up and therefore all our servers lost power once power was restored we needed to do a filesystem check on the router before decrypting and bringing up the storage array and once that was up we were able to bring up all the virtual servers sorry that this all took a while this is the first time in well over a decade that we have had an issue like this sat 08 feb 2020 13 34 00 0000 we hope to have all services restored by 2pm sat 08 feb 2020 12 39 45 0000 we are in the process of bringing services back up sat 08 feb 2020 12 07 11 0000 there has been a power failure at our sheffield datacentre and this has caused all our sheffield services to go down we are on our way to the datacentre now sat 01 feb 2020 22 25 31 0000 the update to webarch email has completed sorry for any inconvenience caused sat 01 feb 2020 22 08 43 0000 we are updating webarch email it will be unavailable for a little while sun 19 jan 2020 20 23 58 0000 we are upgrading webarch email so it will be unavailable for a little while tue 14 jan 2020 10 54 04 0000 there are some issues with the git coop gitlab web interface today we are unsure of the cause however we are going to upgrade the server as this has been needed for a while this wioll result in a little downtime during the day wed 01 jan 2020 12 05 23 0000 webarch1 co uk is up and running again as normal sorry for any inconvenience caused wed 01 jan 2020 11 54 29 0000 we are shutting down webarch1 co uk for a little while while we add additional disk space to it mon 16 dec 2019 10 48 55 0000 we are restarting the webarch email server it will be unavailable for a few minutes thu 12 dec 2019 18 02 45 0000 we are doing a quick restart of the mail webarch email services to enable a configuration change to be enabled mon 09 dec 2019 20 30 29 0000 the upgrade of mail webarch email has been completed sorry for any inconvenience caused during the downtime mon 09 dec 2019 20 00 19 0000 we are upgading mail webarch email it will be unavailable for a little while mon 09 dec 2019 18 52 44 0000 we intend to upgrade mail webarch email from 8pm this evening and expect that the server will be unavailable for a little while while this work is undertaken no email should be lost in this process but some might be delayed a little wed 04 dec 2019 16 28 13 0000 we have just generated a new tls certificate for mail1 ecohost coop so the problems when connecting to the mail server using the old ecohost settings should now be resolved however it would be better if people did update their email clients to use the webarch email settings wed 04 dec 2019 13 59 41 0000 we are very sorry for the inconvenience caused by the lapsing of the ecohost coop domain name this has now been renewed mon 21 oct 2019 22 59 24 0100 sorry for the interruptions in service between 10pm and 10 50pm bst the new router is now in place and we hope that services will be better than ever as a result mon 21 oct 2019 22 01 10 0100 we are installing a new router at our data centre in sheffield all sheffield based services will be unavailable for a little while mon 21 oct 2019 13 21 08 0100 we are planning on replacing the temporary router we have in our sheffield data centre with a new one from 10pm bst tonight this will result in a little downtime but should solve the limited incoming bandwidth issues we currently have sat 19 oct 2019 10 02 50 0100 we believe that the issues with webarch email this morning have now been fully resolved and that no email was lost some will have been delayed once again sorry for the downtime sat 19 oct 2019 09 34 00 0100 we are still having some problems with webarch email we hope to have them resolved soon sat 19 oct 2019 08 46 55 0100 we have resolved the issue with the mailcow upgrade and webarch email is up and running again sorry for the downtime sat 19 oct 2019 07 32 17 0100 we are currently upgrading docker on webarch email and are afraid that this is taking longer than usual wed 16 oct 2019 16 55 09 0100 we are very sorry about the connectivity issues we have had today with all our services hosted in sheffield this was due to an inadequate temporary replacement router we now have a second replacement router one in place and are currently doing some testing on it we hope it will sufficient as a temporary solution while we source and provision a pair of new replacements wed 16 oct 2019 10 29 50 0100 we have just done a very a quick reboot of the replacement router it was only down for a moment we do not anticipate any further downtime once again we are very sorry about the problems this morning wed 16 oct 2019 10 23 35 0100 we are doing a quick reboot of the replacement router it should be back up in a moment wed 16 oct 2019 09 56 38 0100 our sheffield services are restored we are very sorry for the downtime and the inconvenience caused wed 16 oct 2019 09 46 33 0100 we are in the process of configuring a replacement router wed 16 oct 2019 09 23 22 0100 we hope to have all services restored by 10am bst wed 16 oct 2019 09 01 08 0100 all our sheffield services are unavailable following a reboot of our main router which failed to come back up we are on our way to the data centre to resolve the problem sun 13 oct 2019 15 59 59 0100 we are doing some work on our router at 16 00 gmt today and we expect connectivity to all our sheffield servers to be lost at this time for around one minute wed 02 oct 2019 10 03 39 0100 sorry for the git coop downtime this morning we are upgrading it and giving it additional resources more ram and cpus sun 22 sep 2019 14 02 37 0100 we are updating gitlab at git coop and it will be unavailable for a little while fri 20 sep 2019 22 29 30 0100 the upgrade for webarch email has completed fri 20 sep 2019 22 00 35 0100 we are upgrading webarch email and as a result it will be unavailable for a little while tue 03 sep 2019 22 13 37 0100 we are upgrading docker across multiple servers and this will result in some services being unavailable for a while mon 02 sep 2019 22 02 53 0100 the problem with the certificate for webarch email has been fixed mon 02 sep 2019 20 50 36 0100 the upgrade for webarch email is complete mon 02 sep 2019 20 24 58 0100 we are upgrading webarch email so it will be un available for a little while sun 25 aug 2019 02 13 41 0100 we have booted the server and are now bringing up the virtual servers one at a time sun 25 aug 2019 01 42 59 0100 we are at the data centre and checking the bios on the sever sun 25 aug 2019 01 14 01 0100 we are going to the data centre to investigate the problem with the server that is down sat 24 aug 2019 23 12 14 0100 one of our front facing servers is currently off line and this is effecting several of our services we are looking into the cause of this problem mon 22 jul 2019 20 18 12 0100 we are upgrading docker across all our servers and this will result in some downtime for a variety of applications the key one being webarch email wed 17 jul 2019 20 28 39 0100 we are upgrading docker across all our servers and this will result in some downtime for a variety of applications the key one being webarch email wed 03 jul 2019 11 30 18 0100 we are upgrading gitlab at git coop so it will be off line for a little while tue 18 jun 2019 07 39 23 0100 we are rebooting services due to last nights linux kernel update wed 05 jun 2019 14 05 55 0100 we are upgrading out gitlab server at git coop so it will be unavailable for a few minutes mon 03 jun 2019 20 46 34 0100 we are about to apply the may updates to webarch email it will therefore be unavailable for a few minutes mon 03 jun 2019 12 11 16 0100 we are updating the gitlab server at git coop and it will therefore be unavailable for a few minutes mon 22 apr 2019 19 14 00 0100 the update to the webarch email server has been completed mon 22 apr 2019 19 07 48 0100 we are shutting down the webarch email server to apply some updates it shouldn t take long tue 09 apr 2019 11 03 32 0100 the webarch email server is up and running again sorry for any inconvenience caused tue 09 apr 2019 10 54 25 0100 we are restarting the webarch email server to disable the solr search ind...