Page MenuHomePhabricator
Create Task
Maniphest T261912

Convert WMF Deployed Extensions to Abstract Schema
Closed, ResolvedPublic
Actions

Description

As a Goal of the abstract schema project, tracking that all WMF deployed extensions (which is a superset of T261911: Convert Bundled Extensions to Abstract Schema) have been converted to abstract schema. This obviously makes little difference for WMF deployment purposes, but serves the goal of marking a milestone of a reasonable selection of WMF maintained (and deployed) extensions implementing DB schemas in the preferred method for longer term maintainability and support

Done/no DB tables:

  • 3D
  • AbuseFilter - T259377
  • AdvancedSearch
  • AntiSpoof - T268535
  • ApiFeatureUsage
  • ArticleCreationWorkflow
  • ArticlePlaceholder
  • Babel - Linked with T259374
  • BetaFeatures - Linked with T259374
  • BounceHandler - T268538
  • Calendar
  • Campaigns
  • Capiunto
  • CategoryTree
  • CentralAuth - T259376
  • CentralNotice - T268539
  • CharInsert
  • CheckUser - T268540
  • CirrusSearch
  • Cite
  • CiteThisPage
  • Citoid
  • CodeEditor
  • CodeMirror
  • CodeReview - T268541
  • Cognate - T268542
  • Collection
  • CommonsMetadata
  • ConfirmEdit
  • CongressLookup
  • ContactPage
  • ContentTranslation - T268543
  • CreditsSource - T298496
  • Dashiki
  • Disambiguator
  • DiscussionTools - newly created extension - started with abstract schema
  • DismissableSiteNotice
  • DonationInterface - T268545
  • DoubleWiki
  • DynamicSidebar
  • Echo - T259375
  • Elastica
  • ElectronPdfService
  • EntitySchema - T268546
  • EventBus
  • EventLogging
  • EventStreamConfig
  • ExtensionDistributor
  • ExternalGuidance
  • FeaturedFeeds
  • FileExporter
  • FileImporter
  • FlaggedRevs - T268548
  • Flow - T268549
  • FundraiserLandingPage
  • FundraisingTranslateWorkflow
  • GeoData - T268550
  • GWToolset
  • Gadgets
  • GeoCrumbs
  • GettingStarted
  • GlobalBlocking - T268551
  • GlobalCssJs
  • GlobalPreferences - T268552
  • GlobalUsage - T268553
  • GlobalUserPage
  • GoogleNewsSitemap
  • Graph
  • GrowthExperiments - newly created extension - started with abstract schema
  • GuidedTour
  • ImageMap
  • InputBox
  • Insider
  • Interwiki
  • InterwikiSorting
  • Jade - T268555
  • Josa
  • JsonConfig
  • Kartographer
  • LabeledSectionTransclusion
  • LandingCheck
  • LdapAuthentication - T268556
  • Linter - Linked with T259374
  • LiquidThreads - T268559
  • Listings
  • LocalisationUpdate
  • LoginNotify
  • MachineVision - T268560
  • MapSources
  • MassMessage
  • Math - T268561
  • MediaModeration
  • MobileApp
  • MobileFrontend
  • MultimediaViewer
  • NavigationTiming
  • NewUserMessage
  • Newsletter - T268563
  • Nuke
  • OATHAuth - T268564
  • OAuth - T268565
  • OAuthRateLimiter - newly created extension - started with abstract schema
  • OpenStackManager
  • ORES - T268566
  • PageAssessments - T268567
  • PageImages
  • PageTriage - T268568
  • PageViewInfo
  • PagedTiffHandler
  • ParserFunctions
  • PdfHandler
  • Poem
  • PoolCounter
  • Popups
  • ProofreadPage - Linked with T259374
  • PropertySuggester - T268570
  • QuickSurveys
  • Quiz
  • RSS
  • ReadingLists - T268571
  • RelatedArticles
  • Renameuser
  • RevisionSlider
  • SandboxLink
  • Score
  • Scribunto
  • SearchExtraNS
  • SecureLinkFixer
  • SecurePoll - T268572
  • ShortUrl - Linked with T259374
  • SiteMatrix
  • SpamBlacklist
  • SubPageList3
  • SubpageSortkey
  • SyntaxHighlight_GeSHi
  • TemplateData
  • TemplateSandbox
  • TemplateStyles
  • TemplateWizard
  • TextExtracts
  • Thanks
  • TheWikipediaLibrary
  • TimedMediaHandler - Linked with T259374
  • TitleBlacklist
  • TocTree
  • TorBlock
  • Translate - T268576
  • TranslationNotifications
  • TrustedXFF
  • TwoColConflict
  • UniversalLanguageSelector
  • UploadWizard - T268577
  • UploadsLink
  • UrlShortener - Linked with T259374
  • UserMerge
  • VipsScaler
  • VisualEditor
  • WebAuthn
  • WikiEditor
  • WikiLove - Linked with T259374
  • Wikibase - T259411/T205094
  • WikibaseCirrusSearch
  • WikibaseLexeme
  • WikibaseLexemeCirrusSearch
  • WikibaseMediaInfo
  • WikibaseQualityConstraints - T268579
  • Wikidata.org
  • WikidataPageBanner
  • WikimediaApiPortalOAuth
  • WikimediaBadges
  • WikimediaEditorTasks - T268581
  • WikimediaEvents
  • WikimediaIncubator
  • WikimediaMessages
  • Wikisource
  • XAnalytics
  • cldr
  • intersection
  • timeline
  • wikihiero

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedLadsgroupT191231 RFC: Abstract schemas and schema changes
 OpenNoneT259374 Convert extensions to using abstract schema
 ResolvedNoneT261912 Convert WMF Deployed Extensions to Abstract Schema
 ResolvedJdforrester-WMFT259375 Migrate Echo to Abstract Schema
 ResolvedUmherirrenderT306473 Drop foreign keys from echo table echo_push_subscription
 ResolvedUmherirrenderT259376 Migrate CentralAuth to Abstract Schema
 ResolvedUmherirrenderT300576 Standardise type for timestamp columns in CentralAuth extension
 ResolvedUmherirrenderT259377 Migrate AbuseFilter to Abstract Schema
 ResolvedDaimonaT220791 afl_filter should be split in afl_filter_id and afl_global
 ResolvedMarosteguiT234052 Add abuse_filter_log.afl_filter_id and afl_global columns
 ResolvedBstormT234615 Wikireplicas changes for abuse_filter_log including two new columns
 ResolvedDaimonaT269712 Migrate afl_filter to afl_filter_id and afl_global
 ResolvedUrbanecmT269713 Run the MigrateAflFilter script for AbuseFilter
 ResolvedMarosteguiT291719 Remove abuse_filter_log.afl_filter column and adjust schema consequently from Wikimedia production
 ResolvedrookT291806 Remove afl_filter column from the views
 DuplicateNoneT259411 Migrate Wikibase to the abstract schema
 ResolvedUmherirrenderT268535 Convert AntiSpoof to AbstractSchema
 InvalidNoneT268536 Convert Babel to AbstractSchema
 InvalidNoneT268537 Convert BetaFeatures to AbstractSchema
 ResolvedReedyT268538 Convert BounceHandler to AbstractSchema
 ResolvedUmherirrenderT268539 Convert CentralNotice to AbstractSchema
 ResolvedUmherirrenderT310447 Standardise type for timestamp columns in CentralNotice extension
 ResolvedUmherirrenderT268540 Convert CheckUser to AbstractSchema
 ResolvedUmherirrenderT300575 Standardise default for cu_changes.cuc_timestamp on CheckUser extension
 ResolvedUmherirrenderT268542 Convert Cognate to use AbstractSchema changes
 ResolvedUmherirrenderT268543 Convert ContentTranslation to AbstractSchema
 ResolvedUmherirrenderT310448 Standardise type for timestamp columns in ContentTranslation extension
 InvalidNoneT268545 Convert DonationInterface to AbstractSchema
 ResolvedReedyT268546 Convert EntitySchema to AbstractSchema
 ResolvedReedyT268591 Make it possible for abstract schema dbs to not have a PK
 InvalidNoneT268547 Convert EventLogging to AbstractSchema
 ResolvedUmherirrenderT268548 Convert FlaggedRevs to AbstractSchema
 ResolvedUmherirrenderT310437 Standardise type for timestamp columns in FlaggedRevs extension
 ResolvedUmherirrenderT268549 Convert Flow to AbstractSchema
 ResolvedUmherirrenderT310420 Standardise type for timestamp column in Flow extension
 ResolvedJdforrester-WMFT268550 Convert GeoData to AbstractSchema
 ResolvedReedyT268551 Convert GlobalBlocking to AbstractSchema
 ResolvedReedyT268552 Convert GlobalPreferences to AbstractSchema
 ResolvedReedyT268553 Convert GlobalUsage to AbstractSchema
 InvalidNoneT268554 Convert GWToolset to AbstractSchema
 DeclinedNoneT268555 Convert Jade to AbstractSchema
 ResolvedReedyT268556 Convert LdapAuthentication to AbstractSchema
 InvalidNoneT268557 Convert Linter to AbstractSchema
 ResolvedUmherirrenderT268559 Convert LiquidThreads to AbstractSchema
 ResolvedUmherirrenderT310423 Standardise type for timestamp columns in LiquidThreads extension
 ResolvedUmherirrenderT268560 Convert MachineVision to AbstractSchema
 ResolvedPhysikerweltT268561 Convert Math to AbstractSchema
 InvalidNoneT268562 Convert MediaModeration to AbstractSchema
 ResolvedUmherirrenderT268563 Convert Newsletter to AbstractSchema
 ResolvedReedyT268564 Convert OATHAuth to AbstractSchema
 ResolvedUmherirrenderT268565 Convert OAuth to AbstractSchema
 ResolvedUmherirrenderT300446 Standardise type for timestamp columns in OAuth extension
 ResolvedUmherirrenderT268566 Convert ORES to AbstractSchema
 ResolvedReedyT268567 Convert PageAssessment to AbstractSchema
 ResolvedUmherirrenderT268568 Convert PageTriage to AbstractSchema
 ResolvedUmherirrenderT310449 Standardise type for timestamp columns in PageTriage extension
 InvalidNoneT268569 Convert ProofreadPage to AbstractSchema
 ResolvedReedyT268570 Convert PropertySuggester to AbstractSchema
 ResolvedUmherirrenderT268571 Convert ReadingLists to AbstractSchema
 ResolvedSTranT268572 Convert SecurePoll to AbstractSchema
 ResolvedUmherirrenderT272966 Migrate SecurePoll tables that need schema changes to AbstractSchema
 ResolvedTchandersT272965 Migrate SecurePoll tables that have parity to AbstractSchema
 ResolvedUmherirrenderT310444 Standardise type for timestamp columns in SecurePoll extension
 InvalidNoneT268573 Convert ShortUrl to AbstractSchema
 InvalidNoneT268574 Convert Thanks to AbstractSchema
 InvalidNoneT268575 Convert TimedMediaHandler to AbstractSchema
 ResolvedawightT268576 Convert Translate to AbstractSchema
 ResolvedReedyT268577 Convert UploadWizard to AbstractSchema
 InvalidNoneT268578 Convert UrlShortener to AbstractSchema
 ResolvedLadsgroupT268579 Convert WikibaseQualityConstraints to AbstractSchema
 InvalidNoneT268580 Convert WikiLove to AbstractSchema
 ResolvedUmherirrenderT268581 Convert WikimediaEditorTasks to AbstractSchema
 ResolvedUmherirrenderT298496 Convert CreditsSource to AbstractSchema

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Reedy closed subtask T268557: Convert Linter to AbstractSchema as Invalid.Nov 24 2020, 12:44 AM
Reedy closed subtask T268573: Convert ShortUrl to AbstractSchema as Invalid.
Reedy closed subtask T268537: Convert BetaFeatures to AbstractSchema as Invalid.
Reedy closed subtask T268575: Convert TimedMediaHandler to AbstractSchema as Invalid.
Reedy closed subtask T268580: Convert WikiLove to AbstractSchema as Invalid.
Reedy closed subtask T268569: Convert ProofreadPage to AbstractSchema as Invalid.
Reedy updated the task description. (Show Details)Nov 24 2020, 12:48 AM
Reedy updated the task description. (Show Details)
Reedy closed subtask T268574: Convert Thanks to AbstractSchema as Invalid.Nov 24 2020, 12:54 AM
Reedy updated the task description. (Show Details)
Reedy closed subtask T268554: Convert GWToolset to AbstractSchema as Invalid.Nov 24 2020, 2:16 AM
Reedy updated the task description. (Show Details)
Reedy closed subtask T268547: Convert EventLogging to AbstractSchema as Invalid.Nov 24 2020, 3:07 AM
Reedy closed subtask T268562: Convert MediaModeration to AbstractSchema as Invalid.Nov 24 2020, 3:19 AM
Reedy updated the task description. (Show Details)
Reedy closed subtask T268578: Convert UrlShortener to AbstractSchema as Invalid.Nov 24 2020, 4:05 AM
Jdforrester-WMF added a subscriber: Jdforrester-WMF.Dec 11 2020, 11:56 PM
Jdforrester-WMF closed subtask T268577: Convert UploadWizard to AbstractSchema as Resolved.Dec 12 2020, 12:04 AM
Jdforrester-WMF closed subtask T268538: Convert BounceHandler to AbstractSchema as Resolved.
Jdforrester-WMF closed subtask T268551: Convert GlobalBlocking to AbstractSchema as Resolved.
Jdforrester-WMF closed subtask T268552: Convert GlobalPreferences to AbstractSchema as Resolved.
Jdforrester-WMF closed subtask T268553: Convert GlobalUsage to AbstractSchema as Resolved.Dec 12 2020, 12:06 AM
Jdforrester-WMF updated the task description. (Show Details)
Jdforrester-WMF closed subtask T268556: Convert LdapAuthentication to AbstractSchema as Resolved.
Jdforrester-WMF updated the task description. (Show Details)Dec 12 2020, 12:10 AM
Ladsgroup closed subtask T268570: Convert PropertySuggester to AbstractSchema as Resolved.Dec 23 2020, 5:01 AM
Ladsgroup updated the task description. (Show Details)
Ladsgroup closed subtask T268546: Convert EntitySchema to AbstractSchema as Resolved.Dec 23 2020, 5:15 AM
Ladsgroup updated the task description. (Show Details)
Niharika mentioned this in T268572: Convert SecurePoll to AbstractSchema.Jan 13 2021, 5:32 PM
Lucas_Werkmeister_WMDE closed subtask T268579: Convert WikibaseQualityConstraints to AbstractSchema as Resolved.Feb 2 2021, 1:47 PM
Ladsgroup updated the task description. (Show Details)Feb 2 2021, 7:18 PM
Physikerwelt closed subtask T268561: Convert Math to AbstractSchema as Resolved.Feb 20 2021, 6:30 PM
Jdforrester-WMF mentioned this in T259377: Migrate AbuseFilter to Abstract Schema.Apr 5 2021, 12:45 AM
Reedy mentioned this in T280240: Convert Wikispeech to using abstract schema.Apr 15 2021, 10:18 AM
Reedy mentioned this in T280241: Convert WikispeechSpeechDataCollector to using abstract schema.
Ladsgroup closed subtask T268555: Convert Jade to AbstractSchema as Declined.Apr 28 2021, 9:44 PM
Ladsgroup updated the task description. (Show Details)May 21 2021, 10:17 PM
Izno updated the task description. (Show Details)May 24 2021, 11:59 PM
awight closed subtask T268576: Convert Translate to AbstractSchema as Resolved.Nov 23 2021, 8:48 AM
Umherirrender added a subtask: T298496: Convert CreditsSource to AbstractSchema.Jan 3 2022, 10:41 PM
Umherirrender updated the task description. (Show Details)
Ladsgroup closed subtask T268542: Convert Cognate to use AbstractSchema changes as Resolved.Jan 4 2022, 7:09 AM
Ladsgroup updated the task description. (Show Details)
Ladsgroup closed subtask T268567: Convert PageAssessment to AbstractSchema as Resolved.Jan 25 2022, 7:09 PM
Ladsgroup updated the task description. (Show Details)
Reedy closed subtask T268564: Convert OATHAuth to AbstractSchema as Resolved.Feb 19 2022, 8:01 PM
Ladsgroup mentioned this in T300774: Drop fr_img_* columns.Feb 24 2022, 9:16 AM
Umherirrender closed subtask T259376: Migrate CentralAuth to Abstract Schema as Resolved.Mar 15 2022, 5:20 PM
LSobanski added a subscriber: LSobanski.Apr 25 2022, 11:39 AM
Jdforrester-WMF removed a subtask: T268541: Convert CodeReview to AbstractSchema.May 23 2022, 8:56 PM
Umherirrender updated the task description. (Show Details)Jun 6 2022, 6:24 PM
Umherirrender closed subtask T268540: Convert CheckUser to AbstractSchema as Resolved.Jun 10 2022, 12:41 PM
Umherirrender updated the task description. (Show Details)
Umherirrender added a subscriber: Umherirrender.Jun 15 2022, 7:00 PM

Just to inform:
For every open sub task/extension now a patch set for the abstract schema migration exists.

The patch set is often part of a stack of patch sets. To explain:

  • Old patches for updates from before 1.31 are removed, because mediawiki/core does not support further releases and most extension can follow this, its very old [if any old patch set exists]
  • Sql schema files are moved to a folder /sql/ to bundle all files [if not already bundled in a folder, some folder are named /schema/ or other]
  • Timestamp fields are migrated from varying-length columns to fixed-length binary columns to make creating of postgres schema possible (and avoid later change), which require the mwtimestamp type to create timestamp columns [if timestamp columns exists and needs migration]
  • Foreign key references are removed from mysql schema [Echo only]
  • Remove duplicate index defintion [LiquidThreads only]
  • Initial insert statements are removed from schema file [PageTriage and CentralNotice only]
  • The abstract schema patch. It does not contains schema changes for mysql schema. If a postgres schema already exists, it contains schema changes for postgres to remove the schema drift

If another order is better to review for an extension, feel free to ask on patch set, some are possible to do in other order [all not marked as preparation for the abstract schema].

If sql files are moved or renamed and the file is mention in the WikimediaMaintenance extension a patch set for the extension exists as well.

The remove or rename of files are found under topic:schema (and some other changes) - https://gerrit.wikimedia.org/r/q/topic:schema+status:open
The other patches are found under topic:abstract - https://gerrit.wikimedia.org/r/q/topic:abstract+status:open

If this task and the sub tasks are resolved, the next step would be to fix the postgres and sqlite tests and make them voting on CI. Also a new (structure) tests are needed to abstract schema and the generated files are identical (T297211)

Umherirrender closed subtask T268559: Convert LiquidThreads to AbstractSchema as Resolved.Jul 6 2022, 6:42 PM
Umherirrender updated the task description. (Show Details)Jul 6 2022, 7:05 PM
Umherirrender updated the task description. (Show Details)Jul 6 2022, 7:24 PM
Umherirrender closed subtask T268549: Convert Flow to AbstractSchema as Resolved.Jul 7 2022, 5:04 PM
Umherirrender updated the task description. (Show Details)
Ladsgroup closed subtask T268543: Convert ContentTranslation to AbstractSchema as Resolved.Jul 7 2022, 8:10 PM
Umherirrender updated the task description. (Show Details)Jul 7 2022, 8:12 PM
Umherirrender closed subtask T268568: Convert PageTriage to AbstractSchema as Resolved.Jul 8 2022, 6:01 PM
Umherirrender updated the task description. (Show Details)
Umherirrender closed subtask T268563: Convert Newsletter to AbstractSchema as Resolved.Jul 11 2022, 4:50 PM
Umherirrender updated the task description. (Show Details)
Jdforrester-WMF closed subtask T298496: Convert CreditsSource to AbstractSchema as Resolved.Jul 13 2022, 3:52 PM
Jdforrester-WMF closed subtask T268539: Convert CentralNotice to AbstractSchema as Resolved.
Jdforrester-WMF closed subtask T268535: Convert AntiSpoof to AbstractSchema as Resolved.
Jdforrester-WMF closed subtask T268571: Convert ReadingLists to AbstractSchema as Resolved.
Jdforrester-WMF closed subtask T259375: Migrate Echo to Abstract Schema as Resolved.Jul 13 2022, 3:54 PM
Jdforrester-WMF updated the task description. (Show Details)Jul 13 2022, 3:56 PM
Jdforrester-WMF updated the task description. (Show Details)Jul 13 2022, 4:23 PM
Jdforrester-WMF closed subtask T259377: Migrate AbuseFilter to Abstract Schema as Resolved.Jul 13 2022, 5:46 PM
Jdforrester-WMF closed subtask T268550: Convert GeoData to AbstractSchema as Resolved.
Jdforrester-WMF updated the task description. (Show Details)
Jdforrester-WMF closed subtask T268565: Convert OAuth to AbstractSchema as Resolved.Jul 13 2022, 6:01 PM
Jdforrester-WMF updated the task description. (Show Details)Jul 13 2022, 6:07 PM
Jdforrester-WMF closed subtask T268581: Convert WikimediaEditorTasks to AbstractSchema as Resolved.
Jdforrester-WMF updated the task description. (Show Details)Jul 13 2022, 6:09 PM
Jdforrester-WMF closed subtask T268566: Convert ORES to AbstractSchema as Resolved.Jul 13 2022, 6:14 PM
Jdforrester-WMF updated the task description. (Show Details)
Umherirrender closed subtask T268572: Convert SecurePoll to AbstractSchema as Resolved.Jul 13 2022, 6:36 PM
Jdforrester-WMF closed subtask T268560: Convert MachineVision to AbstractSchema as Resolved.Jul 13 2022, 6:38 PM
Jdforrester-WMF updated the task description. (Show Details)
Jdforrester-WMF closed subtask T268548: Convert FlaggedRevs to AbstractSchema as Resolved.Jul 13 2022, 7:12 PM
Jdforrester-WMF updated the task description. (Show Details)
Jdforrester-WMF closed subtask T268545: Convert DonationInterface to AbstractSchema as Invalid.
Jdforrester-WMF closed this task as Resolved.Jul 13 2022, 7:14 PM
Jdforrester-WMF updated the task description. (Show Details)
Jdforrester-WMF added a comment.Jul 13 2022, 9:45 PM

I guess we should send an e-mail to wikitech-l celebrating this milestone. @Umherirrender, would you like to do that, as you did so much of the work?

Umherirrender added a comment.Jul 14 2022, 9:05 PM
In T261912#8076434, @Jdforrester-WMF wrote:

I guess we should send an e-mail to wikitech-l celebrating this milestone. @Umherirrender, would you like to do that, as you did so much of the work?

I am not the best writer of long prose text, but here we are ;-) - https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/GYE6JUPMMCF5IULDVQUSHGZDHDCVSKMO/ (in the attachment, sadly my client has not seen this as text only message ...)

Umherirrender updated the task description. (Show Details)Jul 14 2022, 10:57 PM
Tgr awarded a token.Jul 15 2022, 10:41 PM
Ladsgroup mentioned this in T313251: Collect and fix schema drifts of wmf-deployed extension tables in production.Jul 18 2022, 6:19 PM
Umherirrender mentioned this in T315396: Drop Postgres support from core.Aug 31 2022, 7:22 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL