In order to migrate topics one by one from analytics to Kafka jumbo, we need to run multiple kafkatee instances at once. One will consume from jumbo, the other from analytics.
Description
Description
Details
Details
Customize query in gerrit
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Declined | elukey | T166833 Produce webrequests from varnishkafka to Kafka with Kafka message timestamp set to configurable content field | |||
| Resolved | Ottomata | T152015 Provision new Kafka cluster(s) with security features | |||
| Resolved | Lucas_Werkmeister_WMDE | T145712 Use RDF statement counts from entity data, not page props ( wikibase:identifiers, wikibase:statements and wikibase:sitelinks ) | |||
| Resolved | Ottomata | T161731 Create reliable change stream for specific wiki | |||
| Resolved | Ottomata | T183303 Decomission old analytics kafka cluster | |||
| Resolved | Ottomata | T175461 Port Kafka clients to new jumbo cluster | |||
| Resolved | Ottomata | T185136 Move webrequest varnishkafka and consumers to Kafka jumbo cluster. | |||
| Resolved | Ottomata | T187890 Refactor kafkatee module to support multi instance |
Event Timeline
Comment Actions
Change 413170 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] [WIP] Refactor kafkatee module to support multi instance
Comment Actions
Change 413217 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet/kafkatee@master] Refactor kafkatee module to support multi instance
Comment Actions
Change 413170 abandoned by Ottomata:
Refactor kafkatee module to support multi instance
Reason:
In favor of https://gerrit.wikimedia.org/r/#/c/413217/ in the submodule.
Comment Actions
Change 413217 merged by Ottomata:
[operations/puppet/kafkatee@master] Refactor kafkatee module to support multi instance
Comment Actions
Change 413220 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Update kafkatee submodule with multi instance support
Comment Actions
Change 413220 merged by Ottomata:
[operations/puppet@production] Update kafkatee submodule with multi instance support
Comment Actions
Change 413231 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet/kafkatee@master] Fix typo in kafkatee.systemd.erb WantedBy
Comment Actions
Change 413231 merged by Ottomata:
[operations/puppet/kafkatee@master] Fix typo in kafkatee.systemd.erb WantedBy
Comment Actions
Change 413382 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Fix logrotate file for ops webrequest kafkatee
Comment Actions
Change 413383 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet/kafkatee@master] Rotate kafkatee instance stats files
Comment Actions
Change 413383 merged by Ottomata:
[operations/puppet/kafkatee@master] Rotate kafkatee instance stats files
Comment Actions
Change 413382 merged by Ottomata:
[operations/puppet@production] Fix logrotate files for ops webrequest kafkatee