Page MenuHomePhabricator
Create Task
Maniphest T149438

Replace stat1001
Closed, ResolvedPublic13 Estimated Story Points
Actions

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

• Nuria created this task.Oct 28 2016, 5:54 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 28 2016, 5:54 PM
• Nuria added a comment.Oct 28 2016, 5:56 PM

From our notes:

Replaces OOW R510. stat1001 is just a webhost for large datasets, similar to dataset1001, but more dedicated for analytics cluster generated data. We may be able to consolodate data here onto dataset1* boxes, not sure. This possibly could even be hosted in codfw, if really really necessary.

Now it also runs pivot.

Peachey88 subscribed.Oct 29 2016, 11:02 AM
• Nuria moved this task from Incoming to Backlog (Later) on the Analytics board.Oct 31 2016, 3:30 PM
• Nuria moved this task from Backlog (Later) to Operational Excellence Future on the Analytics board.
• Nuria added a comment.EditedNov 3 2016, 4:00 PM

What is the overall objective?

Replace outdated hardware

Add better resiliency for static domains.

  1. Order new box (Q2)
  1. Move everything (Q2)
  1. Move out everything that can be on a large vm so websites have better resiliency (Q3) pivot analytics.wikimedia.org
• Nuria added a comment.Nov 3 2016, 4:02 PM

Tasks to copy everything:

  • rsync
  • apply puppet
  • put box in varnish
  • announcement
  • switch
• Nuria set the point value for this task to 13.Nov 3 2016, 4:02 PM
• Nuria edited projects, added Analytics-Kanban; removed Analytics.
elukey subscribed.Nov 3 2016, 4:18 PM
Ottomata created subtask T149911: stat1001 replacement box in eqiad.Nov 3 2016, 4:20 PM
RobH added a subtask: T151816: setup/install thorium/wmf4726 as stat1001 replacement.Nov 28 2016, 9:20 PM
RobH closed subtask T149911: stat1001 replacement box in eqiad as Resolved.
Krenair subscribed.Nov 28 2016, 9:33 PM
Ottomata mentioned this in T151816: setup/install thorium/wmf4726 as stat1001 replacement.Nov 29 2016, 2:41 PM
Ottomata closed subtask T151816: setup/install thorium/wmf4726 as stat1001 replacement as Resolved.
Ottomata claimed this task.Nov 29 2016, 5:15 PM
gerritbot subscribed.Nov 29 2016, 5:27 PM

Change 324234 had a related patch set uploaded (by Ottomata):
Puppetize thorium as stat1001 replacement

https://gerrit.wikimedia.org/r/324234

gerritbot added a project: Patch-For-Review.Nov 29 2016, 5:27 PM

Change 324234 merged by Ottomata:
Puppetize thorium as stat1001 replacement

https://gerrit.wikimedia.org/r/324234

gerritbot added a comment.Nov 29 2016, 5:33 PM

Change 324235 had a related patch set uploaded (by Ottomata):
Ensure geowiki base path exists

https://gerrit.wikimedia.org/r/324235

gerritbot added a comment.Nov 29 2016, 5:35 PM

Change 324236 had a related patch set uploaded (by Ottomata):
Add thorium to pivot scap targets

https://gerrit.wikimedia.org/r/324236

gerritbot added a comment.Nov 29 2016, 5:35 PM

Change 324235 merged by Ottomata:
Ensure geowiki base path exists

https://gerrit.wikimedia.org/r/324235

gerritbot added a comment.Nov 29 2016, 5:36 PM

Change 324236 merged by Ottomata:
Add thorium to pivot scap targets

https://gerrit.wikimedia.org/r/324236

gerritbot added a comment.Nov 29 2016, 5:42 PM

Change 324237 had a related patch set uploaded (by Ottomata):
Add thorium to list of statistics_services in hiera

https://gerrit.wikimedia.org/r/324237

gerritbot added a comment.Nov 29 2016, 5:44 PM

Change 324237 merged by Ottomata:
Add thorium to list of statistics_services in hiera

https://gerrit.wikimedia.org/r/324237

Ottomata moved this task from Next Up to In Progress on the Analytics-Kanban board.Nov 29 2016, 5:54 PM
Ottomata reopened subtask T149911: stat1001 replacement box in eqiad as Open.Nov 30 2016, 3:01 PM
RobH closed subtask T149911: stat1001 replacement box in eqiad as Resolved.Nov 30 2016, 11:51 PM
elukey added a comment.Dec 1 2016, 1:57 PM

thorium has been reimaged by Rob, re-deployed pivot (this time it works) and rsynced stats.w.o from stat1001.

gerritbot added a comment.Dec 5 2016, 4:03 PM

Change 325314 had a related patch set uploaded (by Ottomata):
Install zip for statistics::web role (on thorium)

https://gerrit.wikimedia.org/r/325314

gerritbot added a comment.Dec 5 2016, 4:07 PM

Change 325314 merged by Ottomata:
Install zip for statistics::web role (on thorium)

https://gerrit.wikimedia.org/r/325314

gerritbot added a comment.Dec 12 2016, 6:35 PM

Change 326490 had a related patch set uploaded (by Ottomata):
s/stat1001/throrium

https://gerrit.wikimedia.org/r/326490

Ottomata added a comment.Dec 12 2016, 6:52 PM

Announcement out. I plan do do this 15:00 UTC tomorrow Dec 13th.

gerritbot added a comment.Dec 13 2016, 4:26 PM

Change 326490 merged by Ottomata:
s/stat1001/throrium

https://gerrit.wikimedia.org/r/326490

gerritbot added a comment.Dec 13 2016, 4:34 PM

Change 326988 had a related patch set uploaded (by Ottomata):
Remove a few more references to stat1001

https://gerrit.wikimedia.org/r/326988

gerritbot added a comment.Dec 13 2016, 4:36 PM

Change 326988 merged by Ottomata:
Remove a few more references to stat1001

https://gerrit.wikimedia.org/r/326988

Ottomata added a comment.Dec 13 2016, 4:38 PM

Hoookay! Routes changed, the following sites are now routing to thorium:

Ottomata added a comment.Dec 13 2016, 4:40 PM

Next up is to decom stat1001. I'll wait a week or so to verify that thorium is totally good.

gerritbot added a comment.Dec 13 2016, 4:53 PM

Change 326994 had a related patch set uploaded (by Ottomata):
Symlink limn-public-data so it is accessible at datasets.wikimedia.org

https://gerrit.wikimedia.org/r/326994

gerritbot added a comment.Dec 13 2016, 4:56 PM

Change 326994 merged by Ottomata:
Symlink limn-public-data so it is accessible at datasets.wikimedia.org

https://gerrit.wikimedia.org/r/326994

gerritbot added a comment.Dec 13 2016, 5:18 PM

Change 327000 had a related patch set uploaded (by Ottomata):
Fix thorium typo

https://gerrit.wikimedia.org/r/327000

gerritbot added a comment.Dec 13 2016, 5:20 PM

Change 327000 merged by Ottomata:
Fix thorium typo

https://gerrit.wikimedia.org/r/327000

• Nuria moved this task from In Progress to Ready to Deploy on the Analytics-Kanban board.Dec 14 2016, 4:10 PM
gerritbot added a comment.Dec 26 2016, 9:02 PM

Change 329243 had a related patch set uploaded (by Ottomata):
stat1001 is now a spare and can be reclaimed

https://gerrit.wikimedia.org/r/329243

gerritbot added a comment.Dec 26 2016, 9:04 PM

Change 329243 merged by Ottomata:
stat1001 is now a spare and can be reclaimed

https://gerrit.wikimedia.org/r/329243

Stashbot subscribed.Dec 26 2016, 9:16 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-26T21:16:28Z] <ottomata> disabled active checks of stat1001 services T149438

gerritbot added a comment.Dec 26 2016, 9:17 PM

Change 329247 had a related patch set uploaded (by Ottomata):
Remove stat1001 from site.pp

https://gerrit.wikimedia.org/r/329247

gerritbot added a comment.Dec 26 2016, 9:19 PM

Change 329247 merged by Ottomata:
Remove stat1001 from site.pp

https://gerrit.wikimedia.org/r/329247

Ottomata added a subtask: T154164: decommission stat1001.Jan 3 2017, 4:20 PM
Ottomata moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Jan 18 2017, 3:47 PM
• Nuria closed this task as Resolved.Jan 18 2017, 6:19 PM
• Cmjohnson closed subtask T154164: decommission stat1001 as Resolved.Mar 3 2017, 4:44 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL