Page MenuHomePhabricator

[EPIC] Kill the wb_terms table
Open, HighPublic

Description

Production Migration and Killing

Tickets that can be closed once the table is dead

Potentially clossable?

Closed:

Related Objects

StatusSubtypeAssignedTask
OpenNone
OpenNone
ResolvedAddshore
Resolved alaa_wmde
Resolved alaa_wmde
Resolved alaa_wmde
ResolvedNone
DeclinedNone
Declined alaa_wmde
ResolvedLadsgroup
ResolvedAddshore
ResolvedLadsgroup
ResolvedJeroenDeDauw
DeclinedNone
ResolvedNone
ResolvedNone
ResolvedLadsgroup
ResolvedNone
InvalidNone
DeclinedNone
ResolvedLucas_Werkmeister_WMDE
InvalidNone
DeclinedNone
ResolvedLadsgroup
DeclinedNone
ResolvedJeroenDeDauw
DeclinedNone
Resolved alaa_wmde
ResolvedLucas_Werkmeister_WMDE
ResolvedLucas_Werkmeister_WMDE
ResolvedAddshore
ResolvedNone
InvalidNone
Resolved alaa_wmde
OpenLadsgroup
InvalidNone
OpenLadsgroup
ResolvedLadsgroup
OpenLadsgroup
ResolvedLadsgroup
ResolvedLadsgroup
ResolvedLadsgroup
OpenNone
ResolvedAddshore
ResolvedAddshore
ResolvedLadsgroup
OpenLadsgroup
ResolvedJun 17 2019 alaa_wmde
Resolved alaa_wmde
ResolvedJun 18 2019Ladsgroup
ResolvedNone
ResolvedJun 23 2019 alaa_wmde
ResolvedJun 25 2019Ladsgroup
Resolved alaa_wmde
Resolved alaa_wmde
ResolvedBUG REPORT alaa_wmde
OpenLadsgroup
ResolvedAddshore
ResolvedAddshore
ResolvedMarostegui
ResolvedAddshore
ResolvedMarostegui
ResolvedMarostegui
ResolvedAddshore
ResolvedLadsgroup
ResolvedAddshore
DuplicateNone
Resolved alaa_wmde
Declined alaa_wmde
Duplicate alaa_wmde
OpenAddshore
ResolvedLadsgroup
ResolvedLadsgroup
ResolvedLadsgroup
ResolvedLadsgroup
OpenNone
OpenNone
OpenLadsgroup
OpenLadsgroup
OpenLadsgroup
OpenLadsgroup
OpenLadsgroup
OpenLadsgroup
StalledNone
OpenLadsgroup
OpenNone
Resolved alaa_wmde
InvalidNone
DeclinedNone
InvalidNone
ResolvedNone
ResolvedLucas_Werkmeister_WMDE
InvalidNone
InvalidNone
ResolvedLucas_Werkmeister_WMDE
Resolved alaa_wmde
Resolved alaa_wmde
Resolved alaa_wmde
Resolved alaa_wmde
Resolved alaa_wmde
Resolved alaa_wmde
Resolved alaa_wmde
ResolvedLucas_Werkmeister_WMDE
DuplicateNone
ResolvedLadsgroup
ResolvedAddshore
ResolvedLadsgroup
ResolvedAddshore
Resolved alaa_wmde
ResolvedAddshore
ResolvedLadsgroup
ResolvedAddshore
OpenLadsgroup

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Addshore removed alaa_wmde as the assignee of this task.Mar 25 2019, 3:53 PM
Addshore added a subscriber: alaa_wmde.

A first round of work is starting on this EPIC.
The work can be tracked onhttps://phabricator.wikimedia.org/project/profile/3972/

The specific big tickets currently are:

I'm going to expand the description of this task now

Addshore updated the task description. (Show Details)Mar 25 2019, 3:55 PM
Addshore updated the task description. (Show Details)Mar 25 2019, 4:15 PM
Addshore updated the task description. (Show Details)Mar 25 2019, 4:38 PM
Addshore updated the task description. (Show Details)

I see you are going to ask DBAs at T219145, that is great.

As a heads up, because I saw there is a chance of starting using other data stores (which by itself is not an issue), instead of or in addition to MySQL to give a heads up to service operations SREs and probably search too- in the past there has been misunderstandings with sending important/data that has to be persisted to datastores that ops cannot guarantee persistance/are not properly replicated between dcs (e.g. redis). Please do not go beyond the research phase without taking SREs with your proposal to avoid future misunderstandings about storage requirements. CC @Joe @Gehel

I see you are going to ask DBAs at T219145, that is great.
As a heads up, because I saw there is a chance of starting using other data stores (which by itself is not an issue), instead of or in addition to MySQL to give a heads up to service operations SREs and probably search too- in the past there has been misunderstandings with sending important/data that has to be persisted to datastores that ops cannot guarantee persistance/are not properly replicated between dcs (e.g. redis). Please do not go beyond the research phase without taking SREs with your proposal to avoid future misunderstandings about storage requirements. CC @Joe @Gehel

Yup, I have already spent some time talking to the search team, and need to write up a spec of exactly what we want, why, how we will use it etc.
Persistence and freshness are things that would not be needed for the elastic search work mentioned in the task description, and the fallback would always be to sql, but looking up many entity "terms" for many languages elastic is much faster than doing that directly in SQL, even if we then have to lookup any ones missing or out of date from elastic back in SQL.
I should be writing this up this week

Addshore updated the task description. (Show Details)Oct 31 2019, 7:30 AM
Addshore updated the task description. (Show Details)
Addshore triaged this task as High priority.Oct 31 2019, 7:44 AM
Addshore updated the task description. (Show Details)
Ladsgroup updated the task description. (Show Details)Nov 28 2019, 11:14 AM
Ladsgroup updated the task description. (Show Details)Nov 28 2019, 11:19 AM
Ladsgroup updated the task description. (Show Details)Dec 10 2019, 2:48 PM
Addshore updated the task description. (Show Details)Dec 19 2019, 5:27 PM
Ladsgroup updated the task description. (Show Details)Dec 19 2019, 5:45 PM
Addshore updated the task description. (Show Details)Dec 20 2019, 8:27 AM
Addshore updated the task description. (Show Details)Dec 20 2019, 8:35 AM
Ladsgroup updated the task description. (Show Details)Mon, Jan 6, 7:54 AM
Ladsgroup updated the task description. (Show Details)Mon, Jan 6, 8:00 AM
Addshore updated the task description. (Show Details)Tue, Jan 7, 11:20 AM
Addshore updated the task description. (Show Details)
Addshore updated the task description. (Show Details)Wed, Jan 8, 11:21 AM
Addshore updated the task description. (Show Details)Wed, Jan 15, 4:54 PM
Addshore updated the task description. (Show Details)Wed, Jan 15, 4:59 PM
Addshore updated the task description. (Show Details)Wed, Jan 15, 5:07 PM
Addshore updated the task description. (Show Details)Wed, Jan 15, 5:12 PM
Addshore updated the task description. (Show Details)Wed, Jan 15, 5:15 PM
Addshore updated the task description. (Show Details)Thu, Jan 16, 4:07 PM