Page MenuHomePhabricator
Create Task
Maniphest T152712

Replacement of stat1002 and stat1003
Closed, ResolvedPublic0 Estimated Story Points
Actions

Description

Boxes out of warranty

Details

SubjectRepoBranchLines +/-
Remove stat1003 traces for decomoperations/puppetproduction+0 -2
stat1003: remove puppet configuration as part of decomoperations/puppetproduction+19 -50
Remove stat1002 from puppet as part of decom processoperations/puppetproduction+4 -66
statistics: re-add working_path variableoperations/puppetproduction+2 -0
Remove stat1002 configuration as part of decomoperations/puppetproduction+12 -35
Allow rsync to dataset1001 for pagecounts-ezoperations/puppetproduction+1 -1
Sync published datasets more often, allow users to rsyncoperations/puppetproduction+42 -8
Install libcgi-pm-perl for wikistats 1.0 ezachteoperations/puppetproduction+1 -0
Install virtualenv bin on stat boxesoperations/puppetproduction+1 -0
Move geowiki from stat1003 to stat1006operations/puppetproduction+5 -2
statistics::packages: Add libssl-dev and commentsoperations/puppetproduction+24 -25
Move reportupdater jobs from stat1003 -> stat1006operations/puppetproduction+4 -7
Remove dependency on geowiki public data joboperations/puppetproduction+2 -4
Remove checking of public web page data, since it no longer existsanalytics/geowikimaster+2 -129
Remove public data geowiki pushoperations/puppetproduction+1 -10
No longer push to public data repo, we don't use itanalytics/geowikimaster+1 -10
Set up rsync module for /home on stat boxesoperations/puppetproduction+9 -0
Use https gerrit url to clone geowiki data-public on stat1006operations/puppetproduction+1 -1
Backup eventlogging log data from stat1005 srv-log-eventloggingoperations/puppetproduction+10 -6
logrotate reportupdater logs as proper user/groupoperations/puppetproduction+4 -1
Rsync MW API logs to stat1005operations/puppetproduction+12 -7
Move refinery::job::data_check to stat1005 from stat1002operations/puppetproduction+3 -3
Run reportupdater::jobs::hadoop from stat1005 instead of stat1002operations/puppetproduction+1 -1
Use conditionals instead of new role files to deal with stat box migrationoperations/puppetproduction+15 -66
AH, yes, statistics-privatedata-users should be on cruncher, it is a superset of permsoperations/puppetproduction+1 -0
Remove statistics-privatedata-users from stat1006.yaml (cruncher)operations/puppetproduction+0 -1
Add groups to stat1005operations/puppetproduction+8 -2
Apply role statistics::private_new to stat1005operations/puppetproduction+54 -37
Move more stuff into profile::statistics::privateoperations/puppetproduction+21 -24
Own mediawiki/core checkout as statsoperations/puppetproduction+2 -2
MySQL client for stastistics::packages in stretch, /srv/mediawiki diroperations/puppetproduction+18 -3
Package fixes for stat boxes to stretchoperations/puppetproduction+103 -18
geowiki already uses /srv on stat1003, so we can change the backup director path nowoperations/puppetproduction+1 -2
Remove references to geowiki::paramsoperations/puppetproduction+3 -4
Apply cruncher_new role to stat1006operations/puppetproduction+31 -1
Add statistics private, cruncher and web profiles, with a little refactoringoperations/puppetproduction+176 -112
Refactor geowiki a bit and make a geowiki profileoperations/puppetproduction+78 -66
Create reportupdater::jobs profiles for stat boxesoperations/puppetproduction+133 -117
Use stretch for stat1006operations/puppetproduction+2 -0
Install hunspell-en-us instead of myspell-en-us in Stretchoperations/puppetproduction+8 -1
Install jupyter-notebook for stretchoperations/puppetproduction+7 -1
Don't try to set up rsync server for hdfs archive on stat1005 yetoperations/puppetproduction+1 -5
Add stat1005 in site.ppoperations/puppetproduction+35 -0
Prep for stat100[56]operations/puppetproduction+19 -12
Use pulls rather than updates to pull cloudera jessie packages into stretch-wikimediaoperations/puppetproduction+18 -15
Add cloudera-stretch to distributions-wikimedia for stretch-wikimediaoperations/puppetproduction+2 -2
Import cloudera jessie packages into a stretch wikimedia thirdparty componentoperations/puppetproduction+14 -0
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT157807 Reinstall Analytics Hadoop Cluster with Debian Jessie
 DeclinedOttomataT159392 Update jq to v1.4.0 or higher
 ResolvedOttomataT152712 Replacement of stat1002 and stat1003
 ResolvedRobHT159838 EQIAD: stat1002 replacement
Unknown Object (Task)
 ResolvedOttomataT165368 rack/setup/install replacement to stat1005 (stat1002 replacement)
 DeclinedNoneT151904 User limits for stat machines. Limit space on /home dir and possibly /tmp
 ResolvedRobHT159839 EQIAD: stat1003 replacement
Unknown Object (Task)
 ResolvedOttomataT165366 rack/setup/install replacement stat1006 (stat1003 replacement)
 ResolvedOttomataT168683 Upgrade pandoc package to at least 1.12.3
 ResolvedOttomataT170471 Move statistics::discovery jobs from stat1002 -> stat1005
 ResolvedmpopovT170494 [EPIC] Reconfigure Discovery-Stats on Analytics Cluster
 ResolvedmfornsT173333 Reportupdater outputs files with restricted permissions
 ResolvedOttomataT174110 Private data access for non-person user that calculates metrics
 ResolvedOttomataT174465 Puppet admin module should support adding system users to managed groups
 ResolvedAddshoreT170472 Move statistics::wmde jobs from stat1002 -> stat1005
 ResolvedGoranSMilovanovicT170664 Migrate WMDE campaign and WDCM analytics from stat1002, 1003 to stat1005, 1006
 ResolvedelukeyT170878 Audit users and account expiry dates for stat boxes
 DeclinedOttomataT171072 Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005)
 ResolvedOttomataT171373 Unmount /a partition from 1002
 ResolvedErik_ZachteT172032 Pagecounts-ez not generating
 Resolved• CmjohnsonT173097 Decommission stat1002.eqiad.wmnet
 Resolved• CmjohnsonT175150 Decommission stat1003.eqiad.wmnet

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Jul 12 2017, 6:55 PM

Change 364814 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] AH, yes, statistics-privatedata-users should be on cruncher, it is a superset of perms

https://gerrit.wikimedia.org/r/364814

gerritbot added a comment.Jul 12 2017, 6:55 PM

Change 364814 merged by Ottomata:
[operations/puppet@production] AH, yes, statistics-privatedata-users should be on cruncher, it is a superset of perms

https://gerrit.wikimedia.org/r/364814

gerritbot added a comment.Jul 12 2017, 6:59 PM

Change 364817 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Use conditionals instead of new role files to deal with stat box migration

https://gerrit.wikimedia.org/r/364817

gerritbot added a comment.Jul 12 2017, 7:05 PM

Change 364817 merged by Ottomata:
[operations/puppet@production] Use conditionals instead of new role files to deal with stat box migration

https://gerrit.wikimedia.org/r/364817

gerritbot added a comment.Jul 12 2017, 7:07 PM

Change 364823 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Run reportupdater::jobs::hadoop from stat1005 instead of stat1002

https://gerrit.wikimedia.org/r/364823

gerritbot added a comment.Jul 12 2017, 7:07 PM

Change 364823 merged by Ottomata:
[operations/puppet@production] Run reportupdater::jobs::hadoop from stat1005 instead of stat1002

https://gerrit.wikimedia.org/r/364823

RobH unsubscribed.Jul 12 2017, 7:11 PM
gerritbot added a comment.Jul 12 2017, 7:14 PM

Change 364826 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Move refinery::job::data_check to stat1005 from stat1002

https://gerrit.wikimedia.org/r/364826

gerritbot added a comment.Jul 12 2017, 7:14 PM

Change 364826 merged by Ottomata:
[operations/puppet@production] Move refinery::job::data_check to stat1005 from stat1002

https://gerrit.wikimedia.org/r/364826

gerritbot added a comment.Jul 12 2017, 7:39 PM

Change 364829 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Rsync MW API logs to stat1005

https://gerrit.wikimedia.org/r/364829

gerritbot added a comment.Jul 12 2017, 7:40 PM

Change 364829 merged by Ottomata:
[operations/puppet@production] Rsync MW API logs to stat1005

https://gerrit.wikimedia.org/r/364829

Ottomata created subtask T170471: Move statistics::discovery jobs from stat1002 -> stat1005.Jul 12 2017, 8:05 PM
Ottomata created subtask T170472: Move statistics::wmde jobs from stat1002 -> stat1005.
Addshore closed subtask T170472: Move statistics::wmde jobs from stat1002 -> stat1005 as Resolved.Jul 12 2017, 8:50 PM
Addshore reopened subtask T170472: Move statistics::wmde jobs from stat1002 -> stat1005 as Open.Jul 13 2017, 1:13 PM
gerritbot added a comment.Jul 17 2017, 3:10 PM

Change 365614 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] logrotate reportupdater logs as proper user/group

https://gerrit.wikimedia.org/r/365614

Ottomata added a subtask: T170664: Migrate WMDE campaign and WDCM analytics from stat1002, 1003 to stat1005, 1006.Jul 17 2017, 3:56 PM
gerritbot added a comment.Jul 17 2017, 4:21 PM

Change 365614 merged by Ottomata:
[operations/puppet@production] logrotate reportupdater logs as proper user/group

https://gerrit.wikimedia.org/r/365614

gerritbot added a comment.Jul 17 2017, 4:29 PM

Change 365634 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Backup eventlogging log data from stat1005 srv-log-eventlogging

https://gerrit.wikimedia.org/r/365634

gerritbot added a comment.Jul 17 2017, 4:32 PM

Change 365634 abandoned by Ottomata:
Backup eventlogging log data from stat1005 srv-log-eventlogging

Reason:
Ah, I forgot, we were going to stop backing up this data, since it exists on 3 different servers.

https://gerrit.wikimedia.org/r/365634

gerritbot added a comment.Jul 17 2017, 4:35 PM

Change 365640 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Move geowiki from stat1003 to stat1006

https://gerrit.wikimedia.org/r/365640

gerritbot added a comment.Jul 17 2017, 5:33 PM

Change 365640 merged by Ottomata:
[operations/puppet@production] Move geowiki from stat1003 to stat1006

https://gerrit.wikimedia.org/r/365640

gerritbot added a comment.Jul 17 2017, 5:55 PM

Change 365666 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Use https gerrit url to clone geowiki data-public on stat1006

https://gerrit.wikimedia.org/r/365666

gerritbot added a comment.Jul 17 2017, 5:59 PM

Change 365666 merged by Ottomata:
[operations/puppet@production] Use https gerrit url to clone geowiki data-public on stat1006

https://gerrit.wikimedia.org/r/365666

Addshore closed subtask T170472: Move statistics::wmde jobs from stat1002 -> stat1005 as Resolved.Jul 17 2017, 6:10 PM
gerritbot added a comment.Jul 17 2017, 6:11 PM

Change 365668 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Set up rsync module for /home on stat boxes

https://gerrit.wikimedia.org/r/365668

gerritbot added a comment.Jul 17 2017, 6:13 PM

Change 365668 merged by Ottomata:
[operations/puppet@production] Set up rsync module for /home on stat boxes

https://gerrit.wikimedia.org/r/365668

gerritbot added a comment.Jul 17 2017, 6:14 PM

Change 365669 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[analytics/geowiki@master] No longer push to public data repo, we don't use it

https://gerrit.wikimedia.org/r/365669

gerritbot added a comment.Jul 17 2017, 6:17 PM

Change 365670 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Remove public data geowiki push

https://gerrit.wikimedia.org/r/365670

gerritbot added a comment.Jul 17 2017, 6:18 PM

Change 365669 merged by Ottomata:
[analytics/geowiki@master] No longer push to public data repo, we don't use it

https://gerrit.wikimedia.org/r/365669

gerritbot added a comment.Jul 17 2017, 6:19 PM

Change 365670 merged by Ottomata:
[operations/puppet@production] Remove public data geowiki push

https://gerrit.wikimedia.org/r/365670

gerritbot added a comment.Jul 17 2017, 6:24 PM

Change 365671 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[analytics/geowiki@master] Remove checking of public web page data, since it no longer exists

https://gerrit.wikimedia.org/r/365671

gerritbot added a comment.Jul 17 2017, 6:24 PM

Change 365671 merged by Ottomata:
[analytics/geowiki@master] Remove checking of public web page data, since it no longer exists

https://gerrit.wikimedia.org/r/365671

gerritbot added a comment.Jul 17 2017, 6:24 PM

Change 365672 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Remove dependency on geowiki public data job

https://gerrit.wikimedia.org/r/365672

gerritbot added a comment.Jul 17 2017, 6:27 PM

Change 365672 merged by Ottomata:
[operations/puppet@production] Remove dependency on geowiki public data job

https://gerrit.wikimedia.org/r/365672

gerritbot added a comment.Jul 17 2017, 7:16 PM

Change 365684 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Move reportupdater jobs from stat1003 -> stat1006

https://gerrit.wikimedia.org/r/365684

gerritbot added a comment.Jul 17 2017, 7:19 PM

Change 365684 merged by Ottomata:
[operations/puppet@production] Move reportupdater jobs from stat1003 -> stat1006

https://gerrit.wikimedia.org/r/365684

Ottomata created subtask T170878: Audit users and account expiry dates for stat boxes.Jul 17 2017, 8:01 PM
Dzahn subscribed.Jul 17 2017, 9:36 PM

The new server ran out of disk space.

13:29 < icinga-wm> PROBLEM - Disk space on stat1006 is CRITICAL: DISK CRITICAL - free space: / 0 MB (0% inode=95%)

Stashbot subscribed.Jul 18 2017, 7:32 AM

Mentioned in SAL (#wikimedia-operations) [2017-07-18T07:32:10Z] <elukey> moved /home to /srv/home on stat1006 to free disk space (created symling from /home -> /srv/home too) - T152712

GoranSMilovanovic closed subtask T170664: Migrate WMDE campaign and WDCM analytics from stat1002, 1003 to stat1005, 1006 as Resolved.Jul 18 2017, 11:51 AM
Ottomata closed subtask T168683: Upgrade pandoc package to at least 1.12.3 as Resolved.Jul 18 2017, 5:44 PM
gerritbot added a comment.Jul 18 2017, 8:54 PM

Change 366107 had a related patch set uploaded (by Bearloga; owner: Bearloga):
[operations/puppet@production] statistics::packages: Add libssl-dev and comments

https://gerrit.wikimedia.org/r/366107

Ottomata created subtask T171072: Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005).Jul 19 2017, 5:17 PM
Ottomata closed subtask T171072: Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005) as Declined.Jul 21 2017, 12:59 PM
• Nuria created subtask T171373: Unmount /a partition from 1002.Jul 22 2017, 4:50 AM
gerritbot added a comment.Jul 24 2017, 2:19 PM

Change 366107 merged by Ottomata:
[operations/puppet@production] statistics::packages: Add libssl-dev and comments

https://gerrit.wikimedia.org/r/366107

Dzahn unsubscribed.Jul 26 2017, 3:04 PM
leila subscribed.Jul 27 2017, 9:59 PM

@Ottomata I checked stat1002:/a/. Can you copy psinger's folder to stat1005? that's my only request. thanks.

Ottomata added a comment.Jul 28 2017, 2:10 AM

Done. /a/$USER directories from stat1002 are in /srv/stat1002-a/user_dirs_from_stat1002.

stat1002 has been powered off.

JGonsior subscribed.Jul 28 2017, 11:55 AM

Hey, could you please install pip on stat1005?

gerritbot added a comment.Jul 28 2017, 5:54 PM

Change 368461 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Install virtualenv bin on stat boxes

https://gerrit.wikimedia.org/r/368461

gerritbot added a comment.Jul 28 2017, 5:55 PM

Change 368461 merged by Ottomata:
[operations/puppet@production] Install virtualenv bin on stat boxes

https://gerrit.wikimedia.org/r/368461

gerritbot added a comment.Jul 31 2017, 8:44 AM

Change 368612 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] Remove stat1002 configuration as part of decom

https://gerrit.wikimedia.org/r/368612

gerritbot added a comment.Jul 31 2017, 1:14 PM

Change 368763 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Install libcgi-pm-perl for wikistats 1.0 ezachte

https://gerrit.wikimedia.org/r/368763

gerritbot added a comment.Jul 31 2017, 1:16 PM

Change 368763 merged by Ottomata:
[operations/puppet@production] Install libcgi-pm-perl for wikistats 1.0 ezachte

https://gerrit.wikimedia.org/r/368763

gerritbot added a comment.Jul 31 2017, 2:46 PM

Change 368794 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Sync published datasets more often, and allow users to rsync to speed up the process.

https://gerrit.wikimedia.org/r/368794

gerritbot added a comment.Jul 31 2017, 2:55 PM

Change 368794 merged by Ottomata:
[operations/puppet@production] Sync published datasets more often, allow users to rsync

https://gerrit.wikimedia.org/r/368794

mforns added a subtask: T172032: Pagecounts-ez not generating.Jul 31 2017, 3:28 PM
Ottomata added a subscriber: Catrope.Aug 1 2017, 1:10 PM

@Catrope just emailed:

I would love to migrate to stat1006 from stat1003, but stat1006 is unusably slow right now while stat1003 is snappy. Connecting to analytics-store from stat1006 times out sometimes, and even when it doesn't, simple DESCRIBE queries take 5-15 seconds. I just talked to Adam Wight on IRC and he's experiencing similar issues.

Really!? What is slow is the MySQL connection? Not actual usage of stat1006, right?

Ottomata added a comment.Aug 1 2017, 1:12 PM

I can't seem to reproduce...

• Nuria closed subtask T170471: Move statistics::discovery jobs from stat1002 -> stat1005 as Resolved.Aug 2 2017, 12:34 AM
• Nuria closed subtask T171373: Unmount /a partition from 1002 as Resolved.
Catrope added a comment.Aug 3 2017, 12:55 AM
In T152712#3489069, @Ottomata wrote:

@Catrope just emailed:

I would love to migrate to stat1006 from stat1003, but stat1006 is unusably slow right now while stat1003 is snappy. Connecting to analytics-store from stat1006 times out sometimes, and even when it doesn't, simple DESCRIBE queries take 5-15 seconds. I just talked to Adam Wight on IRC and he's experiencing similar issues.

Really!? What is slow is the MySQL connection? Not actual usage of stat1006, right?

This seems to have been fixed now, it's not slow any more.

gerritbot added a comment.Aug 7 2017, 2:59 PM

Change 370478 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Allow rsync to dataset1001 for pagecounts-ez

https://gerrit.wikimedia.org/r/370478

gerritbot added a comment.Aug 7 2017, 3:00 PM

Change 370478 merged by Ottomata:
[operations/puppet@production] Allow rsync to dataset1001 for pagecounts-ez

https://gerrit.wikimedia.org/r/370478

gerritbot added a comment.Aug 11 2017, 2:27 PM

Change 368612 merged by Elukey:
[operations/puppet@production] Remove stat1002 configuration as part of decom

https://gerrit.wikimedia.org/r/368612

gerritbot added a comment.Aug 11 2017, 2:45 PM

Change 371487 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] statistics: re-add working_path variable

https://gerrit.wikimedia.org/r/371487

gerritbot added a comment.Aug 11 2017, 2:47 PM

Change 371487 merged by Elukey:
[operations/puppet@production] statistics: re-add working_path variable

https://gerrit.wikimedia.org/r/371487

gerritbot added a comment.Aug 11 2017, 2:56 PM

Change 371486 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] Remove stat1002 from puppet as part of decom process

https://gerrit.wikimedia.org/r/371486

gerritbot added a comment.Aug 11 2017, 3:10 PM

Change 371486 merged by Elukey:
[operations/puppet@production] Remove stat1002 from puppet as part of decom process

https://gerrit.wikimedia.org/r/371486

Dzahn added a comment.Aug 17 2017, 12:34 AM

There is some cronspam from stat1006:

Cron Daemon root@stat1006.eqiad.wmnet via wikimedia.org

4:30 PM (1 hour ago)

to stats
Error: Value 54312 (2017-08-15) below lower absolute threshold 55000 for column 'Global North (5+)' of global_south (stride: 7)

elukey added subscribers: Dzahn, elukey.Aug 17 2017, 6:24 AM
In T152712#3529686, @Dzahn wrote:

There is some cronspam from stat1006:

Cron Daemon root@stat1006.eqiad.wmnet via wikimedia.org

4:30 PM (1 hour ago)

to stats
Error: Value 54312 (2017-08-15) below lower absolute threshold 55000 for column 'Global North (5+)' of global_south (stride: 7)

I have been trying to fix it for the past two weeks, probably going to move it to analytics-alerts@ to reduce the noise to ops :)

elukey added a comment.Aug 17 2017, 8:12 AM

For the records I created https://phabricator.wikimedia.org/T173486 and moved the cron alert to analytics-alerts@.

gerritbot added a comment.Aug 28 2017, 2:52 PM

Change 374332 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] stat1003: remove puppet configuration as part of decom

https://gerrit.wikimedia.org/r/374332

Ottomata added a comment.Sep 5 2017, 4:14 PM

Today I rsynced /home from stat1003 -> stat1006 with rsync -av --update stat1003.eqiad.wmnet::home/ /home/. Only files that either did not exist on stat1006 or have a newer modification timestamp on stat1003 were copied over. The list of files that were copied is here: https://gist.github.com/ottomata/2743d43188d7d7446a133dac656b12bc

gerritbot added a comment.Sep 5 2017, 5:05 PM

Change 374332 merged by Elukey:
[operations/puppet@production] stat1003: remove puppet configuration as part of decom

https://gerrit.wikimedia.org/r/374332

elukey added a comment.Sep 5 2017, 5:08 PM

stat1003 is official not a analytics host anymore and ssh keys have been removed accordingly, everything (including your home dirs) should already be on stat1006

elukey added a subtask: T173097: Decommission stat1002.eqiad.wmnet.Sep 6 2017, 12:29 PM
elukey added a subtask: T175150: Decommission stat1003.eqiad.wmnet.Sep 6 2017, 12:35 PM
gerritbot added a comment.Sep 6 2017, 1:01 PM

Change 376248 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] Remove stat1003 traces for decom

https://gerrit.wikimedia.org/r/376248

gerritbot added a comment.Sep 6 2017, 1:03 PM

Change 376248 merged by Elukey:
[operations/puppet@production] Remove stat1003 traces for decom

https://gerrit.wikimedia.org/r/376248

Dzahn changed the status of subtask T173097: Decommission stat1002.eqiad.wmnet from Open to Stalled.Sep 7 2017, 2:36 PM
Erik_Zachte closed subtask T172032: Pagecounts-ez not generating as Resolved.Sep 12 2017, 10:29 AM
• Nuria set the point value for this task to 0.Sep 14 2017, 4:16 PM
elukey reopened subtask T173097: Decommission stat1002.eqiad.wmnet as Open.Sep 15 2017, 8:27 AM
elukey added a comment.Sep 15 2017, 8:29 AM

Puppet/Salt cleaned from stat1002/3, the last steps are for DC-ops in the related tasks.

elukey moved this task from In Progress to Done on the Analytics-Kanban board.Sep 15 2017, 8:29 AM
• Nuria closed this task as Resolved.Sep 19 2017, 5:52 PM
• Nuria closed subtask T170878: Audit users and account expiry dates for stat boxes as Resolved.Oct 9 2017, 4:32 PM
• Cmjohnson closed subtask T175150: Decommission stat1003.eqiad.wmnet as Resolved.Apr 24 2018, 7:24 PM
• Tbayer mentioned this in Unknown Object (Task).Jun 25 2018, 9:34 PM
• Cmjohnson closed subtask T173097: Decommission stat1002.eqiad.wmnet as Resolved.Aug 7 2018, 8:42 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL