Page MenuHomePhabricator
Create Task
Maniphest T159200

Update to node-rdkafka 0.8.0
Closed, ResolvedPublic
Actions

Description

A new release of the node Kafka driver has been cut. It brings some important fixes and has the potential to fix the memory leak we've been experiencing with ChangeProp (T153215)

This version depends on a newer version of librdkafka, so we need to make a coordinated update with all the services. There's some backwards incompatible API changes, so services using the driver should be updated:

Details

SubjectRepoBranchLines +/-
Pull librdkafka from apt.wikimedia.org jessie-wikimedia backportsmediawiki/services/eventstreamsmaster+1 -1
Update node-rdkafka to 0.8.0mediawiki/services/trending-editsmaster+3 -3
Update to kafkasse 0.1.0 which depends on node-rdkafka 0.8.0mediawiki/services/eventstreamsmaster+1 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

• Pchelolo created this task.Feb 28 2017, 12:24 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 28 2017, 12:24 AM
gerritbot subscribed.Feb 28 2017, 12:45 AM

Change 340264 had a related patch set uploaded (by Ppchelko; owner: Ppchelko):
Update node-rdkafka to 0.8.0

https://gerrit.wikimedia.org/r/340264

gerritbot added a project: Patch-For-Review.Feb 28 2017, 12:45 AM
• Pchelolo created subtask T159379: Upgrade librdkafka 0.9.4 on SCB and Varnishes.Mar 1 2017, 8:38 PM
• mobrovac added a project: User-mobrovac.Mar 6 2017, 6:19 PM
Ottomata mentioned this in rWKSE7b8b529e7728: Updated node-rdkafka version to 0.8.0.Mar 7 2017, 8:13 PM
gerritbot added a comment.Mar 7 2017, 8:16 PM

Change 341597 had a related patch set uploaded (by Ottomata):
[mediawiki/services/eventstreams] Update to kafkasse 0.1.0 which depends on node-rdkafka 0.8.0

https://gerrit.wikimedia.org/r/341597

gerritbot added a comment.Mar 15 2017, 3:35 PM

Change 341597 merged by Ottomata:
[mediawiki/services/eventstreams] Update to kafkasse 0.1.0 which depends on node-rdkafka 0.8.0

https://gerrit.wikimedia.org/r/341597

gerritbot added a comment.Mar 15 2017, 4:07 PM

Change 340264 merged by Mobrovac:
[mediawiki/services/trending-edits] Update node-rdkafka to 0.8.0

https://gerrit.wikimedia.org/r/340264

gerritbot added a comment.Mar 15 2017, 4:34 PM

Change 342850 had a related patch set uploaded (by Ottomata):
[mediawiki/services/eventstreams] Pull librdkafka from apt.wikimedia.org jessie-wikimedia backports

https://gerrit.wikimedia.org/r/342850

gerritbot added a comment.Mar 15 2017, 4:34 PM

Change 342850 merged by Ottomata:
[mediawiki/services/eventstreams] Pull librdkafka from apt.wikimedia.org jessie-wikimedia backports

https://gerrit.wikimedia.org/r/342850

• mobrovac updated the task description. (Show Details)Mar 15 2017, 4:40 PM
Stashbot subscribed.Mar 15 2017, 5:41 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:41:52Z] <ppchelko@tin> Started deploy [trending-edits/deploy@85be190]: Trending: Update to node-rdkafka 0.8.0. Canary on scb2001. T159200

Stashbot added a comment.Mar 15 2017, 5:42 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:42:49Z] <mobrovac@tin> Started deploy [changeprop/deploy@614cb4b]: Canary deploy for switching to librdkafka 0.9.4 T159200

Stashbot added a comment.Mar 15 2017, 5:43 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:43:13Z] <ppchelko@tin> Finished deploy [trending-edits/deploy@85be190]: Trending: Update to node-rdkafka 0.8.0. Canary on scb2001. T159200 (duration: 01m 21s)

Stashbot added a comment.Mar 15 2017, 5:43 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:43:42Z] <mobrovac@tin> Finished deploy [changeprop/deploy@614cb4b]: Canary deploy for switching to librdkafka 0.9.4 T159200 (duration: 00m 53s)

Stashbot added a comment.Mar 15 2017, 5:46 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:46:40Z] <otto@tin> Started deploy [eventstreams/deploy@eb8698e]: T159200

Stashbot added a comment.Mar 15 2017, 5:46 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:46:58Z] <otto@tin> Finished deploy [eventstreams/deploy@eb8698e]: T159200 (duration: 00m 17s)

Stashbot added a comment.Mar 15 2017, 5:50 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:50:08Z] <ottomata> upgrading librdkafka on scb in codfw T159200

Stashbot added a comment.Mar 15 2017, 5:50 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:50:55Z] <otto@tin> Started deploy [eventstreams/deploy@eb8698e]: T159200

Stashbot added a comment.Mar 15 2017, 5:51 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:51:08Z] <ppchelko@tin> Started deploy [trending-edits/deploy@85be190]: Update to node-rdkafka 0.8.0 in codfw. T159200

Stashbot added a comment.Mar 15 2017, 5:51 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:51:31Z] <mobrovac@tin> Started deploy [changeprop/deploy@614cb4b]: Deploy to CODFW for switching to librdkafka 0.9.4 T159200

Stashbot added a comment.Mar 15 2017, 5:52 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:52:30Z] <otto@tin> Finished deploy [eventstreams/deploy@eb8698e]: T159200 (duration: 01m 35s)

Stashbot added a comment.Mar 15 2017, 5:53 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:53:15Z] <mobrovac@tin> Finished deploy [changeprop/deploy@614cb4b]: Deploy to CODFW for switching to librdkafka 0.9.4 T159200 (duration: 01m 44s)

Stashbot added a comment.Mar 15 2017, 5:55 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T17:55:00Z] <ppchelko@tin> Finished deploy [trending-edits/deploy@85be190]: Update to node-rdkafka 0.8.0 in codfw. T159200 (duration: 03m 51s)

Stashbot added a comment.Mar 15 2017, 6:06 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:06:15Z] <otto@tin> Started deploy [eventstreams/deploy@eb8698e]: T159200

Stashbot added a comment.Mar 15 2017, 6:06 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:06:31Z] <ppchelko@tin> Started deploy [trending-edits/deploy@85be190]: Update to node-rdkafka 0.8.0. Canary on scb1001.eqiad.wmnet. T159200

Stashbot added a comment.Mar 15 2017, 6:07 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:07:38Z] <ppchelko@tin> Finished deploy [trending-edits/deploy@85be190]: Update to node-rdkafka 0.8.0. Canary on scb1001.eqiad.wmnet. T159200 (duration: 01m 07s)

Stashbot added a comment.Mar 15 2017, 6:07 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:07:43Z] <mobrovac@tin> Started deploy [changeprop/deploy@614cb4b]: Deploy to EQIAD canary for switching to librdkafka 0.9.4 T159200

Stashbot added a comment.Mar 15 2017, 6:08 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:07:59Z] <mobrovac@tin> Finished deploy [changeprop/deploy@614cb4b]: Deploy to EQIAD canary for switching to librdkafka 0.9.4 T159200 (duration: 00m 20s)

Stashbot added a comment.Mar 15 2017, 6:12 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:12:52Z] <ottomata> upgrading librdkafka on scb eqiad nodes T159200

Stashbot added a comment.Mar 15 2017, 6:13 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:13:43Z] <otto@tin> Started deploy [eventstreams/deploy@eb8698e]: T159200

Stashbot added a comment.Mar 15 2017, 6:13 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:13:48Z] <ppchelko@tin> Started deploy [trending-edits/deploy@85be190]: Update to node-rdkafka 0.8.0. T159200

Stashbot added a comment.Mar 15 2017, 6:15 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:15:07Z] <mobrovac@tin> Started deploy [changeprop/deploy@614cb4b]: Deploy for switching to librdkafka 0.9.4 T159200

Stashbot added a comment.Mar 15 2017, 6:15 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:15:40Z] <mobrovac@tin> Finished deploy [changeprop/deploy@614cb4b]: Deploy for switching to librdkafka 0.9.4 T159200 (duration: 00m 33s)

Stashbot added a comment.Mar 15 2017, 6:19 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:19:58Z] <ppchelko@tin> Finished deploy [trending-edits/deploy@85be190]: Update to node-rdkafka 0.8.0. T159200 (duration: 06m 11s)

Stashbot added a comment.Mar 15 2017, 6:20 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T18:20:03Z] <otto@tin> Finished deploy [eventstreams/deploy@eb8698e]: T159200 (duration: 06m 18s)

Stashbot added a comment.Mar 15 2017, 7:15 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T19:15:30Z] <mobrovac@tin> Started deploy [changeprop/deploy@b68bf51]: Deploy producer fix for T159200

Stashbot added a comment.Mar 15 2017, 7:16 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-15T19:16:21Z] <mobrovac@tin> Finished deploy [changeprop/deploy@b68bf51]: Deploy producer fix for T159200 (duration: 00m 51s)

• mobrovac closed this task as Resolved.Mar 15 2017, 9:52 PM
• mobrovac triaged this task as Medium priority.
• mobrovac closed subtask T159379: Upgrade librdkafka 0.9.4 on SCB and Varnishes as Resolved.
• mobrovac removed a project: Patch-For-Review.
• mobrovac updated the task description. (Show Details)
• mobrovac updated the task description. (Show Details)
• mobrovac removed a subscriber: gerritbot.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits