Page MenuHomePhabricator

Trending Edit's worker offsets disappear from Kafka
Closed, DeclinedPublic

Description

In the last couple of weeks, we have seen the service workers' offsets disappear on a number of occasions. It seems that Kafka purges them, despite the fact that its offset purge interval is set to one week.

Related Objects

Event Timeline

Change 393382 had a related patch set uploaded (by Mobrovac; owner: Mobrovac):
[mediawiki/services/trending-edits@master] Commit the last committed offset if no commit happened

https://gerrit.wikimedia.org/r/393382

Change 393382 abandoned by Mobrovac:
Commit the last committed offset if no commit happened

Reason:
This would not help, actually.

https://gerrit.wikimedia.org/r/393382

Ping @mobrovac we have little availability in the near term to look at this, can you take care of investigating? Isn't trending edits being decommissioned?

Nuria moved this task from Incoming to Radar on the Analytics board.
mobrovac lowered the priority of this task from High to Low.Nov 30 2017, 5:55 PM

We don't have much bandwidth to look into it right now, but given that T180384: Turn off Trending Service will happen very soon, we likely won't need to at all.

The service has been retired from production, so closing.