[Epic] Write to, populate, and purge data from the CheckUser central index tables
Closed, ResolvedPublic
Actions

Description

Background

The CheckUser central index tables (cuci_temp_edit and cuci_user) need to be written to, purged, and populated with existing data. This is necessary to be able to start work on GUC (T356292) and global auto blocks (T368949).

Acceptance criteria

Data is purged from the cuci_temp_edit and cuci_user tables (we do not need to purge data from cuci_wiki_map) - T371789
Data is written to:
- cuci_user - T373021
- cuci_temp_edit - T371788
Existing CheckUser data from local wikis is populated in both of the above tables - T371789
- The population script is run on WMF wikis - T375203

Related Objects
Search...

Status	Subtype	Assigned	Task
			Restricted Task
Resolved		kostajh	T294511 2021 Security Team wikireplicas audit
Declined		None	T284948 Raw IPs of logged-out users disclosed in wiki-replicas
Resolved		Niharika	T324492 Temporary accounts - MVP
Resolved		Madalina	T326816 [Epic] Update features for temporary accounts
Open		None	T355286 [Epic] Globally blocking a temporary account should prevent further account creations
Resolved		Dreamy_Jazz	T368949 [Epic] Implement global autoblocks from global user blocks
Open		None	T384604 [Epic] Use Codex on Special:GlobalContributions
Open		None	T358048 Use Codex HtmlForm in Special:GlobalContributions
Open		None	T358047 Add ToggleButtonGroup to Special:GlobalContributions for displaying results in a table
Open		None	T371917 Use a time period field in Special:GlobalContributions instead of start/end date fields
Resolved		STran	T356292 Return global contributions by temporary accounts given an IP address or range
Resolved		Dreamy_Jazz	T373018 [Epic] Write to, populate, and purge data from the CheckUser central index tables
Resolved		Dreamy_Jazz	T371789 Create a maintenance script for populating the cuci_temp_edit and cuci_user tables
Resolved		Dreamy_Jazz	T371788 Update cuci_temp_edit table each time a temp user edits
Resolved		Dreamy_Jazz	T373021 Write to cuci_user table when CheckUser actions occur
Resolved		Dreamy_Jazz	T372865 Purge expired data from the cuci_temp_edit and cuci_user tables
Resolved		Dreamy_Jazz	T359560 Create the CheckUserDataPruner service
Resolved		Dreamy_Jazz	T373032 Create a maintenance script to purge expired rows from the recentchanges table
Resolved		Dreamy_Jazz	T371724 Define virtual domains configuration for virtual-checkuser-global on WMF wikis
Resolved		Dreamy_Jazz	T368151 Add a shared table to CheckUser that records changes to different wikis per IP address of the user
Resolved		Dreamy_Jazz	T374530 Make probabilistic write to cuci_user disable-able via a config variable
Declined	PRODUCTION ERROR	None	T374687 Expectation (writes <= 0) by MediaWiki\MediaWikiEntryPoint::restInPeace not met (actual: {actualSeconds}):{query}
Resolved	PRODUCTION ERROR	Dreamy_Jazz	T374994 CheckUser is attempting to write to cuci_user for users which have no central account
Resolved	PRODUCTION ERROR	Dreamy_Jazz	T375063 Do not save data for the system users to cuci_user
Duplicate	PRODUCTION ERROR	None	T376458 Unable to find central ID for local user {username} when recording action in cuci_user table.
Resolved	Security	None	T385734 Account auto-creations caused by import of page caused actor table rows and CheckUser result rows but no associated user table row
Resolved		Dreamy_Jazz	T375203 Run populateCentralCheckUserIndexTables.php on WMF wikis
Resolved		Dreamy_Jazz	T375221 Lots of "SQL query did not specify the caller" warnings
Resolved		Dreamy_Jazz	T375399 CheckUser tests failing when run using sqlite

Event Timeline

Dreamy_Jazz created this task.Aug 21 2024, 12:20 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 21 2024, 12:20 PM

Dreamy_Jazz added a subtask: T372865: Purge expired data from the cuci_temp_edit and cuci_user tables.Aug 21 2024, 12:20 PM

Dreamy_Jazz added subtasks: T368151: Add a shared table to CheckUser that records changes to different wikis per IP address of the user, T371789: Create a maintenance script for populating the cuci_temp_edit and cuci_user tables, T371788: Update cuci_temp_edit table each time a temp user edits.

Dreamy_Jazz added a subtask: T371724: Define virtual domains configuration for virtual-checkuser-global on WMF wikis.

Dreamy_Jazz renamed this task from Write to, populate, and purge data from the CheckUser central index tables to [Epic] Write to, populate, and purge data from the CheckUser central index tables.Aug 21 2024, 12:27 PM

Dreamy_Jazz removed a subtask: T368151: Add a shared table to CheckUser that records changes to different wikis per IP address of the user.

Dreamy_Jazz added a parent task: T368949: [Epic] Implement global autoblocks from global user blocks.

Dreamy_Jazz added a parent task: T356292: Return global contributions by temporary accounts given an IP address or range.Aug 21 2024, 12:29 PM

Dreamy_Jazz claimed this task.Aug 30 2024, 12:31 PM

Dreamy_Jazz updated the task description. (Show Details)

kostajh added a project: Trust and Safety Product Sprint (Sprint Theremin (Aug 26 - Sept. 6)).Sep 2 2024, 12:26 PM

Niharika added a project: CheckUser-GlobalContributions.Sep 4 2024, 5:31 PM

Niharika moved this task from Backlog to Pilot wiki (minor phase) blocker on the CheckUser-GlobalContributions board.Sep 4 2024, 5:35 PM

Lucas_Werkmeister_WMDE mentioned this in T374244: CI failure due to deadlock on cuci_user table.Sep 6 2024, 2:21 PM

kostajh edited projects, added Trust and Safety Product Sprint (Sprint Beatboxing (Sept 16-27)); removed Trust and Safety Product Sprint (Sprint Theremin (Aug 26 - Sept. 6)).Sep 8 2024, 7:49 AM

kostajh added a subtask: T374530: Make probabilistic write to cuci_user disable-able via a config variable.Sep 11 2024, 11:50 AM

kostajh added a subtask: T374687: Expectation (writes <= 0) by MediaWiki\MediaWikiEntryPoint::restInPeace not met (actual: {actualSeconds}):{query}.Sep 13 2024, 7:14 AM

kostajh moved this task from Backlog to Epics in progress on the Temporary accounts (Blockers to minor pilot wiki deployment) board.Sep 15 2024, 5:05 PM

kostajh moved this task from Priority Backlog to In Progress on the Trust and Safety Product Sprint (Sprint Beatboxing (Sept 16-27)) board.Sep 16 2024, 10:21 AM

Dreamy_Jazz added a subtask: T374994: CheckUser is attempting to write to cuci_user for users which have no central account.Sep 18 2024, 8:48 AM

Dreamy_Jazz closed subtask T371788: Update cuci_temp_edit table each time a temp user edits as Resolved.Sep 19 2024, 12:20 PM

Dreamy_Jazz closed subtask T373021: Write to cuci_user table when CheckUser actions occur as Resolved.Sep 19 2024, 12:24 PM

I will start running the population script on WMF wikis.

Dreamy_Jazz added a subtask: T375221: Lots of "SQL query did not specify the caller" warnings.Sep 19 2024, 5:03 PM

kostajh closed subtask T375221: Lots of "SQL query did not specify the caller" warnings as Resolved.Sep 19 2024, 7:22 PM

kostajh closed subtask T372865: Purge expired data from the cuci_temp_edit and cuci_user tables as Resolved.Sep 20 2024, 7:08 AM

Dreamy_Jazz closed subtask T374530: Make probabilistic write to cuci_user disable-able via a config variable as Resolved.Sep 20 2024, 9:27 AM

Dreamy_Jazz closed subtask T374687: Expectation (writes <= 0) by MediaWiki\MediaWikiEntryPoint::restInPeace not met (actual: {actualSeconds}):{query} as Declined.Sep 23 2024, 1:22 PM

Dreamy_Jazz added a project: CheckUser.Sep 23 2024, 4:08 PM

Dreamy_Jazz added a subtask: T375399: CheckUser tests failing when run using sqlite.

Dreamy_Jazz updated the task description. (Show Details)

Dreamy_Jazz closed subtask T375203: Run populateCentralCheckUserIndexTables.php on WMF wikis as Resolved.Sep 27 2024, 11:10 PM

I think we can call this resolved. The remaining subtasks, T374994, has a low enough rate of errors that it can be handled without blocking the resolving of this epic.

Dreamy_Jazz moved this task from Pilot wiki (minor phase) blocker to Done on the CheckUser-GlobalContributions board.Oct 4 2024, 10:59 AM

kostajh moved this task from In Progress to Done on the Trust and Safety Product Sprint (Sprint Beatboxing (Sept 16-27)) board.Oct 8 2024, 10:46 AM

Dreamy_Jazz closed subtask T374994: CheckUser is attempting to write to cuci_user for users which have no central account as Resolved.Dec 6 2024, 4:48 PM

Dreamy_Jazz reopened subtask T374994: CheckUser is attempting to write to cuci_user for users which have no central account as Open.Dec 17 2024, 6:08 PM

Dreamy_Jazz closed subtask T374994: CheckUser is attempting to write to cuci_user for users which have no central account as Resolved.Feb 11 2025, 10:58 AM