Page MenuHomePhabricator

Deprecate and remove non-remex Tidy modes of the core parser
Open, MediumPublic

Description

Set the stage for eventual migration of the core parser to Parsoid by deprecating and removing unsupported non-tidy and non-remex-tidy modes of the core parser.

Details

ProjectBranchLines +/-Subject
mediawiki/extensions/FundraisingEmailUnsubscribemaster+1 -1
mediawiki/coremaster+9 -75
mediawiki/extensions/BlueSpiceFoundationmaster+0 -1
mediawiki/extensions/BlueSpiceFoundationREL1_35+0 -1
mediawiki/coremaster+8 -15
mediawiki/extensions/UploadWizardmaster+0 -1
mediawiki/extensions/AbuseFiltermaster+0 -1
mediawiki/coremaster+1 -36
mediawiki/extensions/Echomaster+0 -1
mediawiki/extensions/Flowmaster+0 -2
mediawiki/extensions/VEForAllmaster+1 -2
mediawiki/extensions/DocBookExportmaster+3 -1
mediawiki/extensions/Commentsmaster+1 -2
mediawiki/extensions/TextExtractsmaster+20 -29
mediawiki/coremaster+7 -3
mediawiki/extensions/BlueSpiceSocialmaster+1 -31
mediawiki/extensions/BlueSpiceFoundationmaster+1 -2
mediawiki/coremaster+45 -327
mediawiki/coremaster+5 -7
mediawiki/coremaster+403 -436
mediawiki/coremaster+81 -43
mediawiki/extensions/TinyMCEmaster+5 -5
mediawiki/skins/Nimbusmaster+5 -2
mediawiki/extensions/WikiArticleFeedsmaster+1 -1
mediawiki/coremaster+8 -171
mediawiki/extensions/WikiForummaster+2 -2
mediawiki/extensions/TranslateSvgmaster+1 -1
mediawiki/extensions/TestLanguageNameGrammarmaster+4 -1
mediawiki/extensions/QuizGamemaster+2 -2
mediawiki/extensions/PollNYmaster+2 -2
mediawiki/extensions/PictureGamemaster+3 -3
mediawiki/extensions/Athenamaster+5 -5
mediawiki/extensions/DataTransfermaster+5 -2
mediawiki/extensions/FanBoxesmaster+3 -3
mediawiki/extensions/DidYouKnowmaster+1 -1
mediawiki/extensions/Commentsmaster+2 -2
mediawiki/extensions/PageFormsmaster+6 -6
mediawiki/extensions/SportsTeamsmaster+3 -3
mediawiki/extensions/SocialProfilemaster+4 -4
mediawiki/extensions/ConfirmAccountmaster+4 -4
mediawiki/extensions/Formmaster+6 -3
mediawiki/extensions/PageFormsmaster+6 -4
mediawiki/extensions/Videomaster+13 -11
mediawiki/coremaster+33 -562
mediawiki/coremaster+13 -0
mediawiki/extensions/SecurePollmaster+3 -4
mediawiki/extensions/Translatemaster+74 -8
mediawiki/coreREL1_32+192 -28
mediawiki/extensions/Collectionmaster+1 -1
mediawiki/coremaster+1 -1
mediawiki/extensions/Collectionmaster+5 -5
mediawiki/coremaster+192 -28
mediawiki/coremaster+42 -20
mediawiki/extensions/ConfirmEditmaster+1 -1
mediawiki/extensions/OAuthmaster+4 -4
mediawiki/extensions/AbuseFiltermaster+5 -7
mediawiki/extensions/CodeReviewmaster+3 -3
mediawiki/extensions/ConfirmEditREL1_32+2 -2
mediawiki/extensions/CentralAuthmaster+6 -8
mediawiki/extensions/TemplateSandboxmaster+10 -3
mediawiki/extensions/VipsScalermaster+4 -1
mediawiki/extensions/FlaggedRevsmaster+2 -2
mediawiki/coremaster+9 -7
mediawiki/extensions/LiquidThreadsmaster+12 -7
mediawiki/extensions/DonationInterfacemaster+11 -1
mediawiki/extensions/Translatemaster+47 -13
mediawiki/coremaster+9 -0
mediawiki/coremaster+5 -3
mediawiki/extensions/SecurePollmaster+9 -9
mediawiki/extensions/Cargomaster+23 -8
mediawiki/extensions/AdManagermaster+13 -13
mediawiki/extensions/SemanticGenealogymaster+16 -16
mediawiki/extensions/MOOCmaster+16 -13
mediawiki/extensions/examplesmaster+8 -5
mediawiki/extensions/CheckUsermaster+4 -5
mediawiki/extensions/WikiLexicalDatamaster+24 -24
mediawiki/coremaster+58 -49
mediawiki/extensions/ConfirmEditmaster+2 -2
mediawiki/extensions/CollaborationKitmaster+2 -2
mediawiki/extensions/FundraiserLandingPagemaster+4 -1
mediawiki/extensions/MassMessagemaster+4 -2
mediawiki/extensions/MapSourcesmaster+9 -3
mediawiki/extensions/FlaggedRevsmaster+2 -2
mediawiki/extensions/ZeroPortalmaster+3 -3
mediawiki/extensions/Collectionmaster+4 -4
mediawiki/extensions/Mathmaster+5 -2
mediawiki/extensions/CentralAuthmaster+1 -1
mediawiki/extensions/CodeReviewmaster+5 -5
mediawiki/extensions/ArticlePlaceholdermaster+4 -4
mediawiki/extensions/CodeReviewmaster+5 -5
mediawiki/extensions/Wikibasemaster+1 -1
mediawiki/coremaster+4 -0
mediawiki/coremaster+3 -2
mediawiki/coremaster+30 -6
mediawiki/extensions/ProofreadPagemaster+1 -1
mediawiki/coremaster+172 -18
mediawiki/extensions/Translatemaster+4 -5
mediawiki/coremaster+1 -1
mediawiki/coremaster+9 -5
mediawiki/coremaster+10 -4
mediawiki/extensions/ProofreadPagemaster+1 -1
mediawiki/coremaster+10 -2
mediawiki/coremaster+22 -3
mediawiki/coremaster+20 -11
Show related patches Customize query in gerrit

Related Objects

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change 565106 merged by Jforrester:
[mediawiki/extensions/ConfirmAccount@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565106

Change 565116 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/FundraisingEmailUnsubscribe@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565116

Change 565103 merged by jenkins-bot:
[mediawiki/extensions/PageForms@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565103

Change 565117 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/PictureGame@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565117

Change 565105 merged by jenkins-bot:
[mediawiki/extensions/SocialProfile@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565105

Change 565119 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/PollNY@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565119

Change 565107 merged by jenkins-bot:
[mediawiki/extensions/SportsTeams@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565107

Change 565121 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/QuizGame@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565121

Change 565122 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/TestLanguageNameGrammar@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565122

Change 565109 merged by jenkins-bot:
[mediawiki/extensions/Comments@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565109

Change 565110 merged by jenkins-bot:
[mediawiki/extensions/DataTransfer@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565110

Change 565111 merged by jenkins-bot:
[mediawiki/extensions/DidYouKnow@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565111

Change 565114 merged by jenkins-bot:
[mediawiki/extensions/FanBoxes@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565114

Change 565123 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/TinyMCE@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565123

Change 565108 merged by Jforrester:
[mediawiki/extensions/Athena@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565108

Change 565117 merged by jenkins-bot:
[mediawiki/extensions/PictureGame@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565117

Change 565126 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/TranslateSvg@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565126

Change 565119 merged by jenkins-bot:
[mediawiki/extensions/PollNY@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565119

Change 565121 merged by jenkins-bot:
[mediawiki/extensions/QuizGame@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565121

Change 565127 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/WikiArticleFeeds@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565127

Change 565128 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/WikiForum@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565128

Change 565129 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/skins/Nimbus@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565129

Change 565122 merged by jenkins-bot:
[mediawiki/extensions/TestLanguageNameGrammar@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565122

Change 565126 merged by jenkins-bot:
[mediawiki/extensions/TranslateSvg@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565126

Change 469882 merged by jenkins-bot:
[mediawiki/core@master] Remove deprecated non-tidy OutputPage::parse/parseInline methods

https://gerrit.wikimedia.org/r/469882

Change 565128 merged by jenkins-bot:
[mediawiki/extensions/WikiForum@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565128

Change 565129 merged by Jack Phoenix:
[mediawiki/skins/Nimbus@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565129

Change 565127 merged by Jforrester:
[mediawiki/extensions/WikiArticleFeeds@master] Replace deprecated OutputPage::parse(), which will be removed from MW

https://gerrit.wikimedia.org/r/565127

Change 565146 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Update parserTests to v2 format (default html/php tests to tidy)

https://gerrit.wikimedia.org/r/565146

Change 461797 merged by jenkins-bot:
[mediawiki/core@master] Support html+untidy tests and version flag in parserTests file

https://gerrit.wikimedia.org/r/461797

Change 565146 merged by jenkins-bot:
[mediawiki/core@master] Update parserTests to v2 format (default html/php tests to tidy)

https://gerrit.wikimedia.org/r/565146

ssastry triaged this task as Medium priority.Feb 27 2020, 1:11 AM

Change 585330 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Remove codepaths which ran parser in 'untidy' mode

https://gerrit.wikimedia.org/r/585330

Change 585331 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Deprecate ParserOptions::getTidy() and ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/585331

Change 585330 merged by jenkins-bot:
[mediawiki/core@master] Remove codepaths which ran parser in 'untidy' mode

https://gerrit.wikimedia.org/r/585330

Change 585331 merged by jenkins-bot:
[mediawiki/core@master] Deprecate ParserOptions::getTidy() and ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/585331

Change 593825 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/BlueSpiceSocial@master] Always tidy the parser output

https://gerrit.wikimedia.org/r/593825

Change 593820 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Deprecate a few more tidy-related methods

https://gerrit.wikimedia.org/r/593820

Change 593827 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/BlueSpiceFoundation@master] Use MWTidy::tidy() directly

https://gerrit.wikimedia.org/r/593827

Change 593879 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/TextExtracts@master] Tidy is no longer configurable in MW 1.35

https://gerrit.wikimedia.org/r/593879

Change 593827 merged by jenkins-bot:
[mediawiki/extensions/BlueSpiceFoundation@master] Use MWTidy::tidy() directly

https://gerrit.wikimedia.org/r/593827

Change 593825 merged by jenkins-bot:
[mediawiki/extensions/BlueSpiceSocial@master] Always tidy the parser output

https://gerrit.wikimedia.org/r/593825

Change 593820 merged by jenkins-bot:
[mediawiki/core@master] Deprecate a few more tidy-related methods

https://gerrit.wikimedia.org/r/593820

Change 593879 merged by jenkins-bot:
[mediawiki/extensions/TextExtracts@master] Tidy is no longer configurable in MW 1.35

https://gerrit.wikimedia.org/r/593879

What's left to do here?

Well, includes/parser/MWTidy.php still exists, along with a couple more of the deprecated-but-not-quite-removed things. I think as soon as 1.35 is branched (well, let's say "next week") we could actually remove those hard-deprecated bits in 1.36 and close out this task.

Here's a short list:

  • ParserBeforeTidy hook
  • includes/parser/MWTidy::singleton() (but pretty much the entire class)
  • ParserOptions::getTidy() / setTidy()
  • maintenance/benchmarks/benchmarkTidy.php (probably)
  • tests/parser/TestFileReader.php support for +untidy
  • tests/parser/editTests.php seems to have mentions of tidy as well
  • tests/parser/parserTests.php has some +tidy clauses which can be cleaned up since that's the default.
  • tests/phpunit/includes/OutputPageTest.php seems to have some untidy tests?

Change 619861 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Remove ParserBeforeTidy hook, deprecated in 1.35

https://gerrit.wikimedia.org/r/619861

Change 619862 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Remove 'tidy' from ParserOptions

https://gerrit.wikimedia.org/r/619862

Change 619863 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Remove all methods of MWTidy except for MWTidy::tidy()

https://gerrit.wikimedia.org/r/619863

Change 619891 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/Flow@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619891

Change 619892 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/AbuseFilter@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619892

Change 619893 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/Echo@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619893

Change 619894 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/UploadWizard@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619894

Change 619895 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/BlueSpiceFoundation@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619895

Change 619896 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/Comments@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619896

Change 619897 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/DocBookExport@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619897

Change 619898 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/extensions/VEForAll@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619898

Change 619861 merged by jenkins-bot:
[mediawiki/core@master] Remove ParserBeforeTidy hook, deprecated in 1.35

https://gerrit.wikimedia.org/r/619861

Change 619891 merged by jenkins-bot:
[mediawiki/extensions/Flow@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619891

Change 619892 merged by jenkins-bot:
[mediawiki/extensions/AbuseFilter@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619892

Change 619893 merged by jenkins-bot:
[mediawiki/extensions/Echo@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619893

Change 619894 merged by jenkins-bot:
[mediawiki/extensions/UploadWizard@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619894

Change 619862 merged by jenkins-bot:
[mediawiki/core@master] Remove 'tidy' from ParserOptions

https://gerrit.wikimedia.org/r/619862

Change 619896 merged by jenkins-bot:
[mediawiki/extensions/Comments@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619896

Change 619897 merged by jenkins-bot:
[mediawiki/extensions/DocBookExport@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619897

Change 619898 merged by jenkins-bot:
[mediawiki/extensions/VEForAll@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619898

Change 619895 merged by Robert Vogel:
[mediawiki/extensions/BlueSpiceFoundation@master] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/619895

Change 620457 had a related patch set uploaded (by Robert Vogel; owner: C. Scott Ananian):
[mediawiki/extensions/BlueSpiceFoundation@REL1_35] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/620457

Change 620457 merged by Robert Vogel:
[mediawiki/extensions/BlueSpiceFoundation@REL1_35] Remove calls to ParserOptions::setTidy()

https://gerrit.wikimedia.org/r/620457

Change 619863 merged by jenkins-bot:
[mediawiki/core@master] Remove all methods of MWTidy except for MWTidy::tidy()

https://gerrit.wikimedia.org/r/619863

ParserMigration is still using \MWTidy::factory and now failing

ParserMigration is still using \MWTidy::factory and now failing

Yeah, if that code ever gets un-abandoned there'll be a bunch of fixes we'll need to do.

Still left:

  • ParserOptions::setTidy() (deprecated in 1.36, needs to be removed in 1.37)
  • maintenance/benchmarks/benchmarkTidy.php (probably)
  • tests/parser/editTests.php seems to have mentions of tidy as well
  • tests/parser/parserTests.php has some +tidy clauses (and +untidy) which can be cleaned up

Moving to "things to do before 1.36" task.

Pppery removed a subscriber: Pppery.Aug 26 2020, 5:00 PM