Page MenuHomePhabricator
Create Task
Maniphest T181346

Trending Edit's worker offsets disappear from Kafka
Closed, DeclinedPublic
Actions

Description

In the last couple of weeks, we have seen the service workers' offsets disappear on a number of occasions. It seems that Kafka purges them, despite the fact that its offset purge interval is set to one week.

Details

ProjectBranchLines +/-Subject
mediawiki/services/trending-editsmaster+8 -0Commit the last committed offset if no commit happened
Customize query in gerrit

Related Objects

Event Timeline

• mobrovac created this task.Nov 25 2017, 8:05 PM
Restricted Application added projects: Analytics, Product-Infrastructure-Team-Backlog. · View Herald TranscriptNov 25 2017, 8:05 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
gerritbot added a subscriber: gerritbot.Nov 25 2017, 8:25 PM

Change 393382 had a related patch set uploaded (by Mobrovac; owner: Mobrovac):
[mediawiki/services/trending-edits@master] Commit the last committed offset if no commit happened

https://gerrit.wikimedia.org/r/393382

gerritbot added a project: Patch-For-Review.Nov 25 2017, 8:25 PM
• mobrovac claimed this task.Nov 25 2017, 8:26 PM
• mobrovac edited projects, added Services (doing), User-mobrovac; removed Services (next).
Milimetric edited projects, added Analytics-Kanban; removed Analytics.Nov 27 2017, 5:13 PM
Milimetric added subscribers: JAllemandou, Ottomata, Milimetric.

ping @Ottomata and @JAllemandou

• mobrovac added a subscriber: elukey.Nov 27 2017, 5:18 PM

ping @elukey too :)

gerritbot added a comment.Nov 28 2017, 4:46 PM

Change 393382 abandoned by Mobrovac:
Commit the last committed offset if no commit happened

Reason:
This would not help, actually.

https://gerrit.wikimedia.org/r/393382

• mobrovac edited projects, added Services (later); removed Services (doing), Patch-For-Review.Nov 28 2017, 4:54 PM
Nuria added a subscriber: Nuria.Nov 30 2017, 5:22 PM

Ping @mobrovac we have little availability in the near term to look at this, can you take care of investigating? Isn't trending edits being decommissioned?

Nuria edited projects, added Analytics; removed Analytics-Kanban.Nov 30 2017, 5:24 PM
Nuria moved this task from Incoming to Radar on the Analytics board.
• mobrovac lowered the priority of this task from High to Low.Nov 30 2017, 5:55 PM

We don't have much bandwidth to look into it right now, but given that T180384: Turn off Trending Service will happen very soon, we likely won't need to at all.

• mobrovac closed this task as Declined.Dec 18 2017, 12:11 PM

The service has been retired from production, so closing.

• mobrovac edited projects, added Services (attic); removed Services (later).Dec 18 2017, 12:11 PM
Aklapper edited projects, added Analytics-Radar; removed Analytics.Jun 10 2020, 6:44 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL