Page MenuHomePhabricator
Create Task
Maniphest T205850

Procure and provision Logging pipeline hardware in multiple datacenters
Closed, ResolvedPublic
Actions

Description

This task tracks the procurement and installation of Logstash hardware in multiple datacenters (i.e. codfw)

Details

SubjectRepoBranchLines +/-
add codfw site to kibana lvs service configurationoperations/puppetproduction+1 -0
add codfw to conftool kibana service datacenter listoperations/puppetproduction+1 -0
logstash: add lvs::realserver to codfw logstash collector nodesoperations/puppetproduction+1 -0
add load balanced service kibana.svc.codfw.wmnet (eqiad backup)operations/puppetproduction+12 -0
assign codfw logging VMs logstash roleoperations/puppetproduction+63 -1
logstash: set kafka consumer group id in codfwoperations/puppetproduction+9 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

fgiunchedi created this task.Oct 1 2018, 12:56 PM
fgiunchedi mentioned this in T63785: Improve HA for logstash cluster.Oct 1 2018, 1:12 PM
herron triaged this task as Medium priority.Oct 2 2018, 5:26 PM
herron claimed this task.Oct 3 2018, 3:53 PM
fgiunchedi moved this task from Backlog to Externally blocked on the Wikimedia-Logstash board.Oct 15 2018, 2:25 PM
fgiunchedi merged a task: T127977: Logstash DC fail-over / per-DC setup.Oct 15 2018, 2:28 PM
fgiunchedi added subscribers: • GWicke, StudiesWorld.
herron mentioned this in Unknown Object (Task).Oct 24 2018, 8:24 PM
Papaul closed subtask Unknown Object (Task) as Resolved.Dec 3 2018, 10:38 PM
herron closed subtask T211217: Spin up 3 logstash/kibana frontend VMs in codfw as Resolved.Dec 5 2018, 9:51 PM
herron added a subtask: T211065: rack/setup/install codfw logstash elasticsearch storage servers.Dec 6 2018, 2:51 PM
herron closed subtask T211065: rack/setup/install codfw logstash elasticsearch storage servers as Resolved.Dec 11 2018, 10:26 PM
gerritbot subscribed.Dec 11 2018, 10:46 PM

Change 479136 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] logstash: set kafka consumer group id in codfw

https://gerrit.wikimedia.org/r/479136

gerritbot added a project: Patch-For-Review.Dec 11 2018, 10:46 PM
gerritbot added a comment.Dec 11 2018, 11:06 PM

Change 479140 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] assign codfw logging VMs logstash role

https://gerrit.wikimedia.org/r/479140

gerritbot added a comment.Dec 12 2018, 7:40 PM

Change 479136 merged by Herron:
[operations/puppet@production] logstash: set kafka consumer group id in codfw

https://gerrit.wikimedia.org/r/479136

gerritbot added a comment.Dec 12 2018, 8:06 PM

Change 479140 merged by Herron:
[operations/puppet@production] assign codfw logging VMs logstash role

https://gerrit.wikimedia.org/r/479140

gerritbot added a comment.Dec 13 2018, 9:15 PM

Change 479541 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] add load balanced service kibana.svc.codfw.wmnet (eqiad backup)

https://gerrit.wikimedia.org/r/479541

gerritbot added a comment.Dec 17 2018, 2:48 PM

Change 479541 merged by Herron:
[operations/puppet@production] add load balanced service kibana.svc.codfw.wmnet (eqiad backup)

https://gerrit.wikimedia.org/r/479541

gerritbot added a comment.Dec 17 2018, 3:44 PM

Change 480096 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] logstash: add lvs::realserver to codfw logstash collector nodes

https://gerrit.wikimedia.org/r/480096

gerritbot added a comment.Dec 17 2018, 3:49 PM

Change 480096 merged by Herron:
[operations/puppet@production] logstash: add lvs::realserver to codfw logstash collector nodes

https://gerrit.wikimedia.org/r/480096

gerritbot added a comment.Dec 17 2018, 4:26 PM

Change 480102 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] add codfw to conftool kibana service datacenter list

https://gerrit.wikimedia.org/r/480102

gerritbot added a comment.Dec 17 2018, 4:29 PM

Change 480102 merged by Herron:
[operations/puppet@production] add codfw to conftool kibana service datacenter list

https://gerrit.wikimedia.org/r/480102

gerritbot added a comment.Dec 17 2018, 6:22 PM

Change 480131 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] add codfw site to kibana lvs service configuration

https://gerrit.wikimedia.org/r/480131

gerritbot added a comment.Dec 17 2018, 6:23 PM

Change 480131 merged by Herron:
[operations/puppet@production] add codfw site to kibana lvs service configuration

https://gerrit.wikimedia.org/r/480131

Stashbot subscribed.Dec 17 2018, 6:32 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-17T18:32:43Z] <herron> performing manual puppet run and manually restarting pybal on lvs2006 to add kibana service T205850

Stashbot added a comment.Dec 17 2018, 6:42 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-17T18:42:40Z] <herron> manually restarting pybal on lvs2003 to add kibana service T205850

herron closed this task as Resolved.Dec 17 2018, 10:11 PM

done!

fgiunchedi added a project: observability.Aug 19 2019, 2:31 PM
Maintenance_bot removed a project: Patch-For-Review.Aug 19 2019, 3:15 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits