Page MenuHomePhabricator

Delete stale kafka topics
Closed, DuplicatePublic

Description

After a lot of kafka topic removals, we have quite a few topics that are not used any more. They pollute the graphs, but with introduction of the regexed ChangeProp subscriptions, they started to have a real danger. If the regex occasionally matches a stale topic, it will subscribe to it holding up one of the valuable libuv threads, so it's better to do a cleanup and delete stale topics.

Here's the list for codfw, same for eqiad:

codfw.mediawiki.page_restore
codfw.change-prop.retry.change-prop.transcludes.continue
codfw.change-prop.retry.mediawiki.page_delete
codfw.change-prop.transcludes.continue
codfw.change-prop.retry.mediawiki.page_restore
codfw.mediawiki.page_move
codfw.change-prop.retry.mediawiki.revision_visibility_set
codfw.mediawiki.page_delete
codfw.change-prop.backlinks.continue
codfw.change-prop.retry.mediawiki.user_block" with 1 partitions
codfw.change-prop.retry.mediawiki.page_move
codfw.mediawiki.revision_create
codfw.change-prop.retry.mediawiki.revision_create
codfw.mediawiki.revision_visibility_set
codfw.change-prop.retry.change-prop.backlinks.continue
codfw.mediawiki.user_block

Event Timeline

Restricted Application added a project: Analytics. · View Herald TranscriptApr 19 2017, 10:06 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

To enable topic deletion we need to put delete.topic.enable=true to the kafka server.properties and restart instances.

Change 349280 had a related patch set uploaded (by Ppchelko):
[operations/puppet@production] Kafka: Enable topic deletion for the main kafka cluster

https://gerrit.wikimedia.org/r/349280

Nuria triaged this task as Normal priority.Apr 24 2017, 3:35 PM
Nuria lowered the priority of this task from Normal to Low.
Nuria moved this task from Incoming to Wikistats Production on the Analytics board.
elukey added a subscriber: elukey.May 29 2017, 3:37 PM

Change 349280 merged by Elukey:
[operations/puppet@production] Kafka: Enable topic deletion for Kafka by default

https://gerrit.wikimedia.org/r/349280