Page MenuHomePhabricator
Create Task
Maniphest T183303

Decomission old analytics kafka cluster
Closed, ResolvedPublic5 Estimated Story Points
Actions

Details

SubjectRepoBranchLines +/-
Remove various kafka analytics cluster related configsoperations/puppetproduction+2 -99
Remove now unused role::kafka::analytics*operations/puppetproduction+0 -173
Set role spare::system for old analytics Kafka brokersoperations/puppetproduction+1 -1
Remove monitoring and alerts for kafka analytics clusteroperations/puppetproduction+16 -10
Customize query in gerrit

Related Objects
Search...

Event Timeline

Nuria created this task.Dec 19 2017, 10:32 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 19 2017, 10:32 PM
Milimetric moved this task from Incoming to Wikistats on the Analytics board.Dec 21 2017, 4:24 PM
Milimetric moved this task from Wikistats to Operational Excellence on the Analytics board.Mar 1 2018, 6:28 PM
Milimetric moved this task from Operational Excellence to Kafka Work on the Analytics board.Mar 1 2018, 6:33 PM
mforns triaged this task as Medium priority.Apr 16 2018, 4:11 PM
Ottomata added a subtask: T175461: Port Kafka clients to new jumbo cluster.May 15 2018, 2:24 PM
Ottomata mentioned this in T188136: Modern Event Platform: Stream Intake Service: Migrate Mediawiki monolog Kafka uses to eventgate-analytics.
fgiunchedi added a subscriber: fgiunchedi.Sep 5 2018, 10:40 AM
mforns raised the priority of this task from Medium to High.Mar 11 2019, 3:48 PM
Milimetric moved this task from Kafka Work to Data Quality on the Analytics board.May 6 2019, 4:01 PM
Milimetric moved this task from Data Quality to Event Platform on the Analytics board.
Ottomata closed subtask T175461: Port Kafka clients to new jumbo cluster as Resolved.Jun 24 2019, 7:32 PM
Ottomata added a subscriber: Ottomata.Jun 24 2019, 7:53 PM

ZERO messages in analytics Kafka cluster. LET's GOOOOO

https://grafana.wikimedia.org/d/000000523/kafka-graphite?refresh=5m&orgId=1

Ottomata claimed this task.Jun 24 2019, 7:53 PM
Ottomata added a project: Analytics-Kanban.
MoritzMuehlenhoff added a subscriber: MoritzMuehlenhoff.Jun 24 2019, 8:03 PM
gerritbot added a comment.Jun 24 2019, 8:29 PM

Change 518814 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Remove monitoring and alerts for kafka analytics cluster

https://gerrit.wikimedia.org/r/518814

gerritbot added a project: Patch-For-Review.Jun 24 2019, 8:29 PM
Ottomata added a subscriber: elukey.Jun 24 2019, 8:29 PM
Nuria added a comment.Jun 24 2019, 8:33 PM

Tears come to my eyes!!!!

Ottomata moved this task from Next Up to In Progress on the Analytics-Kanban board.Jun 24 2019, 8:36 PM
Ottomata set the point value for this task to 5.
gerritbot added a comment.Jun 25 2019, 2:09 PM

Change 518814 merged by Ottomata:
[operations/puppet@production] Remove monitoring and alerts for kafka analytics cluster

https://gerrit.wikimedia.org/r/518814

Maintenance_bot removed a project: Patch-For-Review.Jun 25 2019, 2:10 PM
gerritbot added a comment.Jun 25 2019, 2:15 PM

Change 519023 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Set role spare::system for old analytics Kafka brokers

https://gerrit.wikimedia.org/r/519023

gerritbot added a project: Patch-For-Review.Jun 25 2019, 2:15 PM
gerritbot added a comment.Jun 25 2019, 2:24 PM

Change 519023 merged by Ottomata:
[operations/puppet@production] Set role spare::system for old analytics Kafka brokers

https://gerrit.wikimedia.org/r/519023

Stashbot added a comment.Jun 25 2019, 2:26 PM

Mentioned in SAL (#wikimedia-operations) [2019-06-25T14:26:10Z] <ottomata> shutting down Kafka on old analytics brokers - T183303

gerritbot added a comment.Jun 25 2019, 2:33 PM

Change 519033 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Remove now unused role::kafka::analytics*

https://gerrit.wikimedia.org/r/519033

gerritbot added a comment.Jun 25 2019, 2:34 PM

Change 519033 merged by Ottomata:
[operations/puppet@production] Remove now unused role::kafka::analytics*

https://gerrit.wikimedia.org/r/519033

gerritbot added a comment.Jun 25 2019, 2:40 PM

Change 519034 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Remove various kafka analytics cluster related configs

https://gerrit.wikimedia.org/r/519034

gerritbot added a comment.Jun 25 2019, 2:44 PM

Change 519034 merged by Ottomata:
[operations/puppet@production] Remove various kafka analytics cluster related configs

https://gerrit.wikimedia.org/r/519034

Ottomata added a subtask: T226517: Decommission old Kafka analytics brokers: kafka1012,kafka1013,kafka1014,kafka1020,kafka1022,kafka1023.Jun 25 2019, 2:49 PM
Ottomata moved this task from In Progress to Done on the Analytics-Kanban board.
Maintenance_bot removed a project: Patch-For-Review.Jun 25 2019, 3:10 PM
fgiunchedi mentioned this in T126989: MediaWiki logging & encryption.Jul 2 2019, 1:08 PM
Nuria closed this task as Resolved.Jul 3 2019, 10:24 PM
Papaul closed subtask T226517: Decommission old Kafka analytics brokers: kafka1012,kafka1013,kafka1014,kafka1020,kafka1022,kafka1023 as Resolved.Feb 29 2020, 12:30 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL