Page MenuHomePhabricator
Create Task
Maniphest T18660

Database table cleanup (tracking)
Closed, ResolvedPublicFeature
Actions

Description

Tracking some issues requiring running of maintenance/cleanup scripts on Wikimedia sites...

Version: unspecified
Severity: enhancement
See Also:

Details

Reference
bz16660

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
ResolvedFeatureLadsgroupT18660 Database table cleanup (tracking)
ResolvedNoneT3919 fr.wikipedia.org: Date of next version is earlier than date of current version for some articles
DeclinedNoneT18614 subcat count > 0 for cats with no subcats on dewiki
ResolvedNoneT18629 Corrupt protections in page_restrictions table
ResolvedNoneT18658 Run refreshLinks.php on WMF wikis
ResolvedNoneT14969 Incomplete Renameuser cases on Wikipedia
ResolvedNoneT18666 Run namespaceDupes.php for French Wikinews
ResolvedNoneT16816 Edits reversed in page history
DuplicateNoneT4219 Incorrect revision dates on some revisions in various Wikimedia Foundation wikis
DeclinedNoneT9679 Revisions are switched in edit history
DeclinedNoneT2781 UTF-8 Bug: umlaut misdisplayed
ResolvedNoneT4559 Bogus MediaWiki: message entries in page history
ResolvedFriedhelmWT6312 Username of all whitespaces in German Wikipedia dump file
ResolvedtstarlingT18841 Data corruption apparently related to recompressTracked.php on wikis with $wgLegacyEncoding set
ResolvedNoneT3444 Some categorized pages are (multi) listed as uncategorized
ResolvedNoneT17152 Ghost categories in wanted categories
DuplicateNoneT6744 Error in editing timestamp?
InvalidNoneT11900 Duplicate rows in externallinks table
ResolvedLegoktmT5507 Invalid usernames on Wikimedia web sites
ResolvedNoneT20488 Run refreshCategoryCounts.php on all WMF wikis
ResolvedNoneT7230 Usernames with initial-lowercase letters need to be cleaned up across Wikimedia projects
ResolvedNoneT7280 Invalid titles cannot be unwatched via Special:Watchlist/edit
ResolvedNoneT8871 Database error: Edits not in correct order (afterwards)
ResolvedRobHT15729 Undelete page with invalid title at en.wikipedia
ResolvedNoneT19343 LogEventsList.php's getQueryInfo() INNER JOIN neglects log_user=0, causing deleteBatch.php's 'Delete page script' entries to be skipped
ResolvedRobHT19476 Run 'fix redirects' for nl.wikipedia (possibly more sites need it)
ResolvedRobHT14168 Ghost entries in bgwiki.categorylinks; wanted categories affected
InvalidNoneT17779 Recalculate statistic data
ResolvedNoneT12667 Category link tables sometimes contain orphaned entries
ResolvedNoneT19716 Some categories remain in Wantedcategories but they are empty
ResolvedNoneT22641 Add namespace aliases for zhwiki.
ResolvedNoneT19751 clean up null filenames from database by update.php
InvalidNoneT12834 site_stats.ss_good_articles and site_stats.ss_total_pages not synchronized with the real count
DuplicateBUG REPORTNoneT24392 Revisions existing in both archive and revision tables
ResolvedtstarlingT18012 Schema change rotation script
ResolvedaaronT5732 The logging table needs a log_user_text field so that events from anonymous users can be logged
ResolvedRobHT19802 Update commons image count
DuplicateNoneT18036 Number of category members (PAGESINCATEGORY) is inaccurate for large categories
ResolvedtstarlingT22757 Corruption of text from early 2005 due to HistoryBlobStub pointers broken by recompressTracked.php
ResolvedNoneT16365 Entries in the image table with invalid titles
DeclinedNoneT29711 Run populateLogUsertext.php on Wikimedia wikis
ResolvedNoneT16672 Diff and revision unshowable, and user denies to have done this edit
ResolvedRobHT18514 Special:Allpages for namespace 0 sometimes shows project namespace pages (namespaceDupes.php?)
ResolvedNoneT28223 Errors in the revision table
ResolvedKrenairT26675 Revision 186704908 on en.wikipedia.org, Fatal exception: unknown "cluster16"
DeclinedNoneT24936 Job queue issues with categories
InvalidNoneT31782 [DO NOT USE] Maintenance scripts waiting to be run on Wikimedia wikis (tracking) [superseded by #WMF-maintenance-script-run]
ResolvedNoneT21919 Article count in Special:Statistics incorrect
DeclinedtstarlingT21990 text of revisions in the archive table that were deleted before Wikipedia started using MediaWiki 1.5 is corrupt
ResolvedKrenairT22017 Special:Statistics shows -1 active users
ResolvedNoneT22143 Please repair broken kshwiki site stats.
Resolved• werdnaT25236 Set all le_type to 'abusefilter' where le_type = 'abusefilte'
ResolvedNoneT30465 Incubator needs database maintenance
ResolvedNoneT25430 Clean up leftovers of WP: alias on dewiki
ResolvedNoneT32185 Global account not appearing on Special:GlobalUsers – do maintenance/runBatchedQuery.php
ResolvedArielGlennT25529 populateSha1 for some images on commons
ResolvedNoneT19057 Images with wrong SHA1
ResolvedReedyT23881 Update archive table for old user renames
ResolvedNoneT23962 Run refreshLinks.php --redirects-only on all wikis
ResolvedNoneT30701 Run script on all wikis to mark revisions older than Apr 2008 as new when they are
ResolvedhasharT30805 incorrect interwiki link zh-classic because of wrong database data
ResolvedNoneT25847 Clean up table user_newtalk
ResolvedNoneT36014 ipblocks.ipb_address has inconsistent format
DeclinedNoneT29480 Fix page_props and iwlinks: run refreshLinks.php
ResolvedNoneT30628 cleanup iwlinks table on WMF wikis
ResolvedLadsgroupT42626 Standardise type of timestamp database fields (MySQL)
ResolvedNoneT42866 Remove $wgOldChangeTagsIndex
ResolvedNoneT42867 Update change tag indexes
ResolvedReedyT48183 Populate archive.ar_len on all Wikimedia wikis
ResolvedNoneT14188 Run maintenance/populateRevisionLength.php on all WMF wikis
ResolvedNoneT33204 Remove old user.user_options
InvalidNoneT33218 Run convertUserOptions on all Wikimedia Wikis
ResolvedAnomieT33223 Remove old archive.ar_text/archive.ar_flags
DeclinedNoneT34858 Do not parse .js/.css pages and save their parsed content in database tables
ResolvedUmherirrenderT36960 drop unused fields recentchanges.rc_moved_to_ns and recentchanges.rc_moved_to_title
ResolvedNoneT36981 Rerun populateParentId from some IDs (English Wikipedia)
ResolvedNoneT45913 Please create and run a maintenance script to consolidate some user rights changes made at Meta-Wiki
ResolvedKrinkleT45917 Delete all redundant "MediaWiki" pages for system messages
Resolvedbd808T63223 run maintenance script to repair EducationProgram summary data
ResolvedLegoktmT63876 Attach all broken autocreated local accounts to their global account
ResolvedLegoktmT71291 Run migrateAccount.php without --safe or --auto
ResolvedNemo_bisT73559 Spurious entry in globalimagelinks for File:France_demographie.png
ResolvedLegoktmT76512 Remove invalid emails from the database
ResolvedLegoktmT89482 Figure out what to do with non-existent wikis that are still connected to SUL
ResolvedLegoktmT75181 Remove HHVM and PHP7 revision tags
ResolvedUmherirrenderT92775 Clean up broken CheckUser block log parameters
InvalidArielGlennT68676 Around 1% of usernames lack valid userid (is 0 instead)
InvalidNoneT112369 Revisions where rev_user_text differs from user_name
ResolvedNoneT24907 Inconsistent values of rev_user_text on pl.wikipedia due to incomplete renames (apparently)
ResolvedArielGlennT29992 user names show up in <ip> tags
ResolvedNoneT5631 security gap: IP style user names - IP range style user names - hijacking these accounts
ResolvedKrenairT117440 Clean up "gadget--%" rows from user_properties on Wikimedia wikis
ResolvedLadsgroupT54778 Clean up skin user preferences in user_properties table on Wikimedia wikis
DeclinedNoneT29807 Restore missing CheckUser logs
DeclinedNoneT87716 Missing rows from categorylinks on production servers (dewiki)
ResolvedKartikMistryT172364 Remove cx_drafts table from production
Restricted Task
Restricted Task
ResolvedLSobanskiT54921 Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking)
ResolvedAmmarpadT270033 Fix and enforce table prefix usage in columns and indexes in core
· · ·

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Nemo_bis added a subtask: T106941: Early edits on en.wiki with rev_user = 0 and truncated rev_user_text.Sep 12 2015, 10:45 AM
Hex subscribed.Sep 12 2015, 12:59 PM
Hex added a subtask: T29992: user names show up in <ip> tags.Sep 12 2015, 1:34 PM
Hex added a subtask: T5631: security gap: IP style user names - IP range style user names - hijacking these accounts.
Nemo_bis added a subtask: T117440: Clean up "gadget--%" rows from user_properties on Wikimedia wikis.Nov 5 2015, 7:27 AM
Krenair closed subtask T117440: Clean up "gadget--%" rows from user_properties on Wikimedia wikis as Resolved.Nov 6 2015, 9:04 PM
Catrope set Security to None.Nov 13 2015, 8:21 PM
Catrope unsubscribed.
Nemo_bis added a subtask: T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.Nov 23 2015, 8:43 AM
Nemo_bis mentioned this in T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.
Krenair closed subtask T22017: Special:Statistics shows -1 active users as Resolved.Nov 26 2015, 5:01 PM
Bawolff added a subtask: Restricted Task.Feb 7 2016, 2:25 PM
Restricted Application added a subscriber: JEumerus. · View Herald TranscriptFeb 7 2016, 2:25 PM
Teles subscribed.Feb 9 2016, 6:02 AM
jcrespo added a project: DBA.Feb 21 2016, 8:01 PM
Krenair closed subtask T26675: Revision 186704908 on en.wikipedia.org, Fatal exception: unknown "cluster16" as Resolved.Mar 9 2016, 8:39 PM
Danny_B moved this task from Tag to Should be workboard column instead on the Tracking-Neverending board.Jul 10 2016, 12:35 AM
Quiddity removed a parent task: T4007: [DO NOT USE] Tracking bug [superseded by #Tracking].Jul 14 2016, 3:07 AM
Danny_B merged a task: T27762: DB repair issues.Jul 30 2016, 10:36 PM
Danny_B added a subtask: T142725: Clean up revision UNIQUE indexes.Aug 11 2016, 5:39 PM
jcrespo removed a subtask: T142725: Clean up revision UNIQUE indexes.Aug 11 2016, 6:05 PM
Liuxinyu970226 subscribed.Sep 10 2016, 6:41 AM
Nemo_bis closed subtask T73559: Spurious entry in globalimagelinks for File:France_demographie.png as Resolved.Oct 16 2016, 9:30 AM
Liuxinyu970226 mentioned this in T54921: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking).Dec 18 2016, 5:50 AM
Nemo_bis added a subtask: T123313: Some revisions on Chinese Wikisource have timestamps from January 1970 and January 2001.Dec 27 2016, 7:32 PM
Liuxinyu970226 updated the task description. (Show Details)Dec 28 2016, 7:51 AM
Liuxinyu970226 removed a subscriber: • wikibugs-l-list.
Krinkle closed subtask T45917: Delete all redundant "MediaWiki" pages for system messages as Resolved.Mar 7 2017, 5:22 AM
MarcoAurelio closed subtask T31782: [DO NOT USE] Maintenance scripts waiting to be run on Wikimedia wikis (tracking) [superseded by #WMF-maintenance-script-run] as Invalid.Mar 15 2017, 12:46 PM
Krinkle removed a subtask: T21311: User edit counts (user.user_editcount field) is often wrong.Apr 28 2017, 1:02 AM
Krinkle changed the status of subtask T24097: Populate user.user_registration DB field on every wiki from Open to Stalled.Apr 30 2017, 3:33 AM
Krinkle added a subtask: T29807: Restore missing CheckUser logs.Apr 30 2017, 3:46 AM
Krinkle added a subtask: T87716: Missing rows from categorylinks on production servers (dewiki).May 8 2017, 1:32 AM
KartikMistry added a subtask: T172364: Remove cx_drafts table from production.Aug 3 2017, 12:17 PM
• Marostegui closed subtask T172364: Remove cx_drafts table from production as Resolved.Aug 16 2017, 3:27 PM
jcrespo reopened subtask T172364: Remove cx_drafts table from production as Open.Aug 16 2017, 3:32 PM
Bawolff added a subtask: Restricted Task.Aug 16 2017, 6:04 PM
Bawolff added a subtask: Restricted Task.Aug 20 2017, 9:22 PM
• Marostegui closed subtask T172364: Remove cx_drafts table from production as Resolved.Aug 21 2017, 7:43 AM
Reedy added a subtask: T174513: Maintenance script to cleanup querycache.Aug 29 2017, 10:16 PM
• Marostegui closed subtask T42867: Update change tag indexes as Resolved.Oct 9 2017, 12:03 PM
• Marostegui moved this task from Triage to Meta/Epic on the DBA board.Oct 9 2017, 12:12 PM
• Marostegui closed subtask Restricted Task as Resolved.Nov 2 2017, 2:21 PM
• Marostegui closed this task as a duplicate of T54921: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking).Apr 27 2018, 1:39 PM
Restricted Application removed a subscriber: Liuxinyu970226. · View Herald TranscriptApr 27 2018, 1:39 PM
• Marostegui subscribed.Apr 27 2018, 1:39 PM
This comment was removed by • Marostegui.
• Marostegui reopened this task as Open.Apr 27 2018, 1:42 PM
• Marostegui removed a project: DBA.Apr 27 2018, 1:46 PM
jcrespo added a subtask: T54921: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking).Apr 27 2018, 1:47 PM
jcrespo updated the task description. (Show Details)Apr 27 2018, 1:50 PM
Hex added a subtask: T112377: Revisions on enwiki from July 2004 with incorrect rev_user.Apr 27 2018, 2:31 PM
Teles unsubscribed.Apr 27 2018, 2:33 PM
Niharika reopened subtask T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis as Open.May 1 2018, 12:47 AM
hashar closed subtask T33223: Remove old archive.ar_text/archive.ar_flags as Resolved.May 4 2018, 7:55 PM
Krinkle added a subtask: T108434: Some rows (from the year 2004) in SQL databases have text in latin1 encoding.Aug 14 2018, 3:14 AM
Reedy changed the status of subtask T18036: Number of category members (PAGESINCATEGORY) is inaccurate for large categories from Open to Stalled.Feb 10 2019, 1:32 AM
Jdforrester-WMF closed subtask T75181: Remove HHVM and PHP7 revision tags as Resolved.Dec 20 2019, 1:18 PM
DannyS712 changed the status of subtask T36320: Remove obsolete recentchanges.rc_new database field from Open to Stalled.Apr 24 2020, 1:57 AM
DannyS712 closed subtask T112369: Revisions where rev_user_text differs from user_name as Invalid.Jun 10 2020, 11:36 PM
Aklapper changed the status of subtask T15196: Screen all previously uploaded SVG files for invalid structure from Open to Stalled.Aug 22 2020, 7:49 AM
matmarex closed subtask T24907: Inconsistent values of rev_user_text on pl.wikipedia due to incomplete renames (apparently) as Resolved.Mar 1 2021, 8:20 PM
LSobanski closed subtask T54921: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) as Resolved.May 17 2021, 11:45 AM
Nintendofan885 subscribed.May 22 2021, 10:01 AM
Ladsgroup closed subtask T42626: Standardise type of timestamp database fields (MySQL) as Resolved.May 23 2021, 1:47 PM
Aklapper changed the subtype of this task from "Task" to "Feature Request".Feb 4 2022, 11:01 AM
Aklapper removed subscribers: • Purodha, • RobLa-WMF.
Krinkle closed subtask T270033: Fix and enforce table prefix usage in columns and indexes in core as Resolved.Feb 28 2022, 11:15 PM
Umherirrender closed subtask T12667: Category link tables sometimes contain orphaned entries as Resolved.Apr 2 2022, 7:51 PM
Reedy changed the status of subtask T29807: Restore missing CheckUser logs from Open to Stalled.Jan 31 2023, 2:09 AM
• Dreamy_Jazz closed subtask T29807: Restore missing CheckUser logs as Declined.Sep 11 2023, 9:28 AM
matmarex closed subtask T87716: Missing rows from categorylinks on production servers (dewiki) as Declined.Sep 26 2023, 1:11 AM
Ladsgroup closed subtask T11900: Duplicate rows in externallinks table as Invalid.Oct 13 2023, 10:42 AM
Ladsgroup subscribed.Jan 2 2025, 2:44 PM

I suggest turning this into a tag and closing this ticket. I'll implement this if there is no objections by the next two weeks.

Ladsgroup closed subtask T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis as Resolved.Jan 2 2025, 3:39 PM
waldyrious unsubscribed.Jan 2 2025, 3:43 PM
Pppery removed a project: Wikimedia-Site-requests.Jan 2 2025, 5:03 PM
Ladsgroup removed a subtask: T2323: Edits from various users active before 2003 are missing from Special:Contributions.Jan 20 2025, 1:48 PM
Ladsgroup removed a subtask: T18674: Broken revisions with rev_page=0.
Ladsgroup removed a subtask: T15196: Screen all previously uploaded SVG files for invalid structure.
Ladsgroup removed a subtask: T17889: Write and run script to find non-existent images on Wikimedia wikis.
Ladsgroup removed a subtask: T25235: Renameuser: Migrate old log entries.
Ladsgroup removed a subtask: T24097: Populate user.user_registration DB field on every wiki.Jan 20 2025, 1:50 PM
Ladsgroup removed a subtask: T41011: redirect, pagelinks and page.page_is_redirect table information out of sync.
Ladsgroup removed a subtask: T36320: Remove obsolete recentchanges.rc_new database field.
Ladsgroup removed a subtask: T106941: Early edits on en.wiki with rev_user = 0 and truncated rev_user_text.Jan 20 2025, 1:52 PM
Ladsgroup removed a subtask: Restricted Task.
Ladsgroup removed a subtask: T123313: Some revisions on Chinese Wikisource have timestamps from January 1970 and January 2001.Jan 20 2025, 1:55 PM
Ladsgroup closed subtask Restricted Task as Resolved.Jan 20 2025, 1:58 PM
Ladsgroup removed a subtask: T174513: Maintenance script to cleanup querycache.Jan 20 2025, 2:00 PM
Ladsgroup removed a subtask: T112377: Revisions on enwiki from July 2004 with incorrect rev_user.
Ladsgroup closed this task as Resolved.Jan 20 2025, 2:02 PM
Ladsgroup claimed this task.
Ladsgroup removed a subtask: T108434: Some rows (from the year 2004) in SQL databases have text in latin1 encoding.
Ladsgroup removed a subtask: T28741: Migrate file tables to a modern layout (image/oldimage; file/filerevision; add primary keys).

Replaced with Wikimedia-database-table-cleanup

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits