Page MenuHomePhabricator

Create <dc>.change-prop.partitioned.mediawiki.job.refreshLinks topic
Closed, ResolvedPublic

Description

We need to create a 'partitioned' topic in both DCs with 8 partitions and other settings similar to all the rest of the topics.

Event Timeline

Pchelolo triaged this task as High priority.Mar 20 2018, 5:42 PM
Pchelolo created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 20 2018, 5:42 PM
Ottomata renamed this task from Create mediawiki.job.refreshLinks_partitioned topic to Create <dc>.change-prop.partitioned.mediawiki.job.refreshLinks topic.Mar 21 2018, 2:58 PM
Ottomata updated the task description. (Show Details)

Done in both eqiad and codfw for both prefixed topics, e.g.:

[@kafka1001:/home/otto] $ kafka topics --describe --topic eqiad.change-prop.partitioned.mediawiki.job.refreshLinks
kafka-topics --zookeeper conf1001.eqiad.wmnet,conf1002.eqiad.wmnet,conf1003.eqiad.wmnet/kafka/main-eqiad --describe --topic eqiad.change-prop.partitioned.mediawiki.job.refreshLinks
Topic:eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	PartitionCount:8	ReplicationFactor:3	Configs:
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 0	Leader: 1001	Replicas: 1001,1002,1003	Isr: 1001,1002,1003
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 1	Leader: 1002	Replicas: 1002,1003,1001	Isr: 1002,1003,1001
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 2	Leader: 1003	Replicas: 1003,1001,1002	Isr: 1003,1001,1002
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 3	Leader: 1001	Replicas: 1001,1003,1002	Isr: 1001,1003,1002
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 4	Leader: 1002	Replicas: 1002,1001,1003	Isr: 1002,1001,1003
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 5	Leader: 1003	Replicas: 1003,1002,1001	Isr: 1003,1002,1001
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 6	Leader: 1001	Replicas: 1001,1002,1003	Isr: 1001,1002,1003
	Topic: eqiad.change-prop.partitioned.mediawiki.job.refreshLinks	Partition: 7	Leader: 1002	Replicas: 1002,1003,1001	Isr: 1002,1003,1
Pchelolo closed this task as Resolved.Mar 21 2018, 3:11 PM

Thank you!