Complete actor table and comment table migration
Open, MediumPublic
Actions

Description

Deploy refactored actor and comment storage, alter revision table to add columns referring to the new tables, and remove temporary relation tables.

Related Objects
Search...

Status	Assigned	Task
Open	None	T161671 Compacting the revision table
Open	None	T227047 Complete actor table and comment table migration
Open	Anomie	T215466 Remove revision_comment_temp and revision_actor_temp
Resolved	Anomie	T166733 Deploy refactored comment storage
Resolved	Anomie	T166732 Refactor comment storage in the database and abstract access in MediaWiki
Resolved	None	T166798 Decide whether back-compat views for upcoming major schema changes will be provided in the Labs replicas
Duplicate	None	T232531 Refactor Comment fields for CheckUser Component
Stalled	None	T233004 Schema changes for `cu_changes` and `cu_log` table
Resolved	Marostegui	T174569 Schema change for refactored comment storage
Resolved	Bstorm	T181650 Change views for the new columns of the refactored comment storage
Declined	None	T210935 Blank out remaining rev_comment fields on Wikimedia wikis
Resolved	Anomie	T210937 API query for userprops not working on group0 wikis (maybe because comment migration read-new)
Resolved	Anomie	T212972 Remove reference to text fields replaced by the comment table from WMCS views
Open	None	T208690 create revision_commentindex
Resolved	Anomie	T188327 Deploy refactored actor storage
Resolved	Marostegui	T188299 Schema change for refactored actor storage
Resolved	Bstorm	T195747 Create views for the schema change for refactored actor storage
Open	Anomie	T167246 Refactor "user" & "user_text" fields into "actor" reference table
Resolved	Jdforrester-WMF	T188183 Add the "actor" table to the database layout documentation
Resolved	Ciencia_Al_Poder	T188710 Adapt grabbers to support the new actor table
Open	None	T205353 Clean up empty ar_user_text and rev_user_text fields
Open	None	T229092 Investigate migrateActors script failing due to duplicate empty actor_name
Resolved	Marostegui	T187089 Fix WMF schemas to not break when comment store goes WRITE_NEW
Resolved	Anomie	T204669 Slow access to Special:Contributions on mediawiki.org (due to enabling actor table WRITE_BOTH mode)
Resolved	Catrope	T204764 DB error in PageTriage: Unknown column 'actor_rev_user.actor_user' in 'on clause'
Resolved	Anomie	T204767 Special:ActiveUsers fails with "Error: 1054 Unknown column 'rc_actor' in 'on clause' (10.192.32.110)"
Resolved	Anomie	T209847 Clean up actor renames on mediawikiwiki
Resolved	Anomie	T210621 Internal api error: CannotCreateActorException
Resolved	Anomie	T215464 Oversighters can no longer see suppressed contributions past a certain date when using the offender parameter
Resolved	Anomie	T215525 log_search rows with ls_field='target_author_actor' and empty ls_value are created during actor migration
Resolved	Anomie	T223406 Remove reference to fields replaced by the actor table from WMCS views
Resolved	Niharika	T219324 Update tools maintained by Community-Tech to use new actor storage
Resolved	MaxSem	T219328 Update Event Metrics to use new actor storage
Resolved	MusikAnimal	T223667 Update to use new actor storage
Resolved	Bstorm	T221339 Missing index on revision_userindex.rev_actor
Resolved	Milimetric	T224134 Finish actor migration in refinery sqoop and refinery source
Open	None	T225007 Update operator/user manual description of database tables changed for refactored actor storage

Event Timeline

CCicalese_WMF created this task.Jul 1 2019, 11:47 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 1 2019, 11:47 PM

CCicalese_WMF added subtasks: T215466: Remove revision_comment_temp and revision_actor_temp, T166733: Deploy refactored comment storage, T188327: Deploy refactored actor storage.Jul 1 2019, 11:48 PM

CCicalese_WMF triaged this task as Medium priority.Jul 1 2019, 11:55 PM

CCicalese_WMF updated the task description. (Show Details)

Hi, I am guessing you will communicate with us (DBAs) on subtasks about the details of how to proceed with this, as this seems quite a complex set of changes, right? We are looking forward to decrease the footprint of revision! :-D

@jcrespo Yes, of course. This is just a tracking task to link all of the required subtasks. Communication with DBAs will continue on the subtasks.

ArielGlenn added a subscriber: ArielGlenn.Jul 2 2019, 1:27 PM

WDoranWMF removed a project: Core Platform Team Legacy (Epic).Jul 5 2019, 7:26 PM

WDoranWMF edited projects, added Core Platform Team (Revision Storage Schema Improvements); removed Core Platform Team (Needs Cleaning - Code Health (TEC13)).Jul 9 2019, 7:02 PM

CCicalese_WMF added a parent task: T161671: Compacting the revision table.Jul 9 2019, 7:04 PM

WDoranWMF moved this task from Revision Storage Schema Improvements to mop on the Core Platform Team board.Jul 26 2019, 7:11 PM

WDoranWMF edited projects, added CPT Initiatives (Revision Storage Schema Improvements); removed Core Platform Team (Revision Storage Schema Improvements).

Anomie closed subtask T188327: Deploy refactored actor storage as Resolved.Sep 17 2019, 5:40 PM

Anomie closed subtask T166733: Deploy refactored comment storage as Resolved.

🎉