Page MenuHomePhabricator

Implement real-time updates to completion suggester index in Elasticsearch 5
Closed, DeclinedPublic

Description

Implement real time updates and gradually enable it on production to see if we can handle the extra load.

Event Timeline

It is unclear whether this investigation can be done before upgrading to ES5 (tracked in T154501) right now.

Deskana triaged this task as Medium priority.Jan 3 2017, 7:50 PM
Deskana raised the priority of this task from Medium to High.Mar 14 2017, 5:12 PM

Change 342819 had a related patch set uploaded (by DCausse):
[mediawiki/extensions/CirrusSearch] Implement RT updates for completion

https://gerrit.wikimedia.org/r/342819

Change 342820 had a related patch set uploaded (by DCausse):
[mediawiki/extensions/CirrusSearch] Implement RT updates for completion

https://gerrit.wikimedia.org/r/342820

Change 342819 abandoned by DCausse:
Implement RT updates for completion

https://gerrit.wikimedia.org/r/342819

dcausse renamed this task from Investigate the performance of real-time updates to completion suggester index in Elasticsearch 5 to Implement real-time updates to completion suggester index in Elasticsearch 5.Mar 16 2017, 10:52 AM
dcausse updated the task description. (Show Details)

moving back to in progress, the first patch proposed is flawed and most probably won't work due to race conditions and is likely to cause much more issues than it solves.

We should figure out if we want to dedicate the time needed to figure this out. There is an email thread going around about this to determine if/how/when.

Moving this to the backlog for now - until we decide how, if and when to do it.

Deskana changed the task status from Open to Stalled.May 5 2017, 4:13 PM
Deskana removed dcausse as the assignee of this task.
Deskana lowered the priority of this task from High to Medium.
Deskana added a subscriber: dcausse.

We have decided not to continue work on this for now. There's a lot of open questions, and it's very unclear from where we stand right now how much work this would be. It's quite possible that we'd open a can of worms trying to do this due to the complexity and it'd turn into a time sink. The user value is still clear, but it seems it's not in line with the expected effort to implement it.

Change 342820 abandoned by DCausse:
Implement RT updates for completion

Reason:
too complex and costly to be worthwhile

https://gerrit.wikimedia.org/r/342820

Aklapper changed the task status from Stalled to Open.EditedMay 31 2020, 3:54 PM
Aklapper lowered the priority of this task from Medium to Lowest.

We have decided not to continue work on this for now. There's a lot of open questions, and it's very unclear from where we stand right now how much work this would be. It's quite possible that we'd open a can of worms trying to do this due to the complexity and it'd turn into a time sink. The user value is still clear, but it seems it's not in line with the expected effort to implement it.

This does not define as stalled ("If a report is waiting for further input (e.g. from its reporter or a third party) and can currently not be acted on"). Hence resetting task status and lowering priority. If this task is out of scope and nobody should ever work on this, then this task should have the "Declined" status instead.

MPhamWMF subscribed.

Closing out low/est priority tasks over 6 months old with no activity within last 6 months in order to clean out the backlog of tickets we will not be addressing in the near term. Please feel free to reopen if you think a ticket is important, but bare in mind that given current priorities and resourcing, it is unlikely for the Search team to pick up these tasks for the indefinite future. We hope that the requested changes have either been addressed by or made irrelevant by work the team has done or is doing -- e.g. upgrading Elasticsearch to a newer version will solve various ES-related problems -- or will be subsumed by future work in a more generalized way.

RhinosF1 removed a project: Discovery-Search.
RhinosF1 subscribed.

Re-opening tasks and removing from team workboard per IRC feedback given yesterday and discussion with MPham.

Closing because Elasticsearch 5 is no longer relevant for us