Page MenuHomePhabricator
Create Task
Maniphest T90363

Upgrade box for EventLogging (vanadium)
Closed, ResolvedPublic
Actions

Description

Upgrade box for EventLogging, the current box we use -vanadium- is to be replaced by a newer, most robust system

Details

SubjectRepoBranchLines +/-
Send server side eventlogging logs to eventlog1001 instead of vanadiumoperations/mediawiki-configmaster+1 -1
Use ensure => present for default varnish::loggingoperations/puppetproduction+1 -1
Use ensure => absent for varnish::logging vanadiumoperations/puppetproduction+1 -1
Use eventlog1001 as main eventlogging host instead of vanadiumoperations/puppetproduction+46 -31
Puppetize eventlog1001operations/puppetproduction+8 -0
Customize query in gerrit

Related Objects

Event Timeline

• Nuria created this task.Feb 22 2015, 12:21 AM
• Nuria raised the priority of this task from to Needs Triage.
• Nuria updated the task description. (Show Details)
• Nuria subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 22 2015, 12:21 AM
• Nuria added projects: Analytics-Kanban, MediaWiki-extensions-EventLogging.Feb 22 2015, 12:22 AM
• Nuria set Security to None.
Liuxinyu970226 subscribed.Feb 22 2015, 12:40 AM
• kevinator triaged this task as High priority.Feb 24 2015, 3:20 PM
• ggellerman added subscribers: faidon, • Tnegrin.Feb 24 2015, 11:06 PM
• kevinator updated the task description. (Show Details)Mar 17 2015, 12:23 AM
• kevinator moved this task from Next Up to Paused on the Analytics-Kanban board.Mar 19 2015, 6:25 PM
• kevinator moved this task from Paused to In Progress on the Analytics-Kanban board.
• ggellerman assigned this task to Ottomata.Mar 27 2015, 2:16 PM
Ottomata added a subscriber: ori.Mar 30 2015, 4:24 PM

@ori, do you know the status of this? Nuria says that you know of some box that has been slated for this use? I'm happy to go ahead and do this upgrade, if you will point me in the right direction.

yuvipanda added a project: acl*sre-team.Apr 2 2015, 9:31 PM
yuvipanda subscribed.
PROBLEM - RAID on vanadium is CRITICAL: CRITICAL: Active: 4, Working: 4, Failed: 2, Spare: 0

Just happened, so this box needs to be replaced pretty quickly. now.

yuvipanda raised the priority of this task from High to Unbreak Now!.Apr 2 2015, 9:35 PM

since this is a SPOF for EventLogging, and plenty of people will be sadface if eventlogging dies.

Ottomata added a comment.Apr 3 2015, 2:32 PM

Found the machine, finally! https://phabricator.wikimedia.org/T90904 On it...

gerritbot subscribed.Apr 3 2015, 3:44 PM

Change 201718 had a related patch set uploaded (by Ottomata):
Puppetize eventlog1001

https://gerrit.wikimedia.org/r/201718

gerritbot added a project: Patch-For-Review.Apr 3 2015, 3:44 PM

Change 201718 merged by Ottomata:
Puppetize eventlog1001

https://gerrit.wikimedia.org/r/201718

Ottomata mentioned this in rOPUP9bfc27307e62: Puppetize eventlog1001.Apr 3 2015, 3:47 PM
gerritbot added a comment.Apr 3 2015, 4:30 PM

Change 201724 had a related patch set uploaded (by Ottomata):
Use eventlog1001 as main eventlogging host instead of vanadium

https://gerrit.wikimedia.org/r/201724

gerritbot added a comment.Apr 3 2015, 4:49 PM

Change 201724 merged by Ottomata:
Use eventlog1001 as main eventlogging host instead of vanadium

https://gerrit.wikimedia.org/r/201724

Ottomata mentioned this in rOPUP31cae723f550: Use eventlog1001 as main eventlogging host instead of vanadium.Apr 3 2015, 4:49 PM
gerritbot added a comment.Apr 3 2015, 5:32 PM

Change 201734 had a related patch set uploaded (by Ottomata):
Use ensure => absent for varnish::logging vanadium

https://gerrit.wikimedia.org/r/201734

gerritbot added a comment.Apr 3 2015, 5:33 PM

Change 201734 merged by Ottomata:
Use ensure => absent for varnish::logging vanadium

https://gerrit.wikimedia.org/r/201734

Ottomata mentioned this in rOPUP672920583694: Use ensure => absent for varnish::logging vanadium.Apr 3 2015, 5:33 PM
gerritbot added a comment.Apr 3 2015, 5:35 PM

Change 201735 had a related patch set uploaded (by Ottomata):
Use ensure => present for default varnish::logging

https://gerrit.wikimedia.org/r/201735

gerritbot added a comment.Apr 3 2015, 5:35 PM

Change 201735 merged by Ottomata:
Use ensure => present for default varnish::logging

https://gerrit.wikimedia.org/r/201735

Ottomata mentioned this in rOPUP3196131da692: Use ensure => present for default varnish::logging.Apr 3 2015, 5:36 PM
gerritbot added a comment.Apr 3 2015, 5:47 PM

Change 201737 had a related patch set uploaded (by Ottomata):
Send server side eventlogging logs to eventlog1001 instead of vanadium

https://gerrit.wikimedia.org/r/201737

gerritbot added a comment.Apr 3 2015, 5:48 PM

Change 201737 merged by jenkins-bot:
Send server side eventlogging logs to eventlog1001 instead of vanadium

https://gerrit.wikimedia.org/r/201737

Ottomata mentioned this in rOMWCa70d30146d91: Send server side eventlogging logs to eventlog1001 instead of vanadium.Apr 3 2015, 5:48 PM
Ottomata added a comment.Apr 3 2015, 6:26 PM

Things are looking good! eventlog1001 has fully taken over all vanadium duties. I will leave vanadium up for now, and decommission it next week.

yuvipanda closed this task as Resolved.Apr 3 2015, 9:20 PM

Yay :)

Liuxinyu970226 unsubscribed.Apr 4 2015, 4:30 AM
• kevinator moved this task from In Progress to Done on the Analytics-Kanban board.Apr 7 2015, 2:15 PM
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:54 PM
Restricted Application added subscribers: Jay8g, TerraCodes. · View Herald TranscriptJun 7 2017, 6:54 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits