Maniphest T96949

Consider using Parsoid's scrubWikitext
Closed, ResolvedPublic
Actions

Description

This is a parameter for html2wt (which we use anytime someone edits existing content with a wikitext editor) that applies certain normalizations. Per an email from @ssastry, the main goal is to help solve VE problems that are best addressed on the Parsoid side.

Currently, it is opt-in and doesn't do anything, but normalizations will soon be added (if they haven't been already).

Related Objects

Mentioned In: rMEXTd97a4b6175e0: Updated mediawiki/extensions Project: mediawiki/extensions/Flow…
rEFLW61619e985654: Pass scrubWikitext=true to Parsoid

Event Timeline

• Mattflaschen-WMF created this task.Apr 23 2015, 3:07 AM

• Mattflaschen-WMF raised the priority of this task from to Needs Triage.

• Mattflaschen-WMF updated the task description. (Show Details)

• Mattflaschen-WMF added a project: StructuredDiscussions.

• Mattflaschen-WMF added subscribers: • Mattflaschen-WMF, ssastry.

Restricted Application added a project: Collaboration-Team-Triage. · View Herald TranscriptApr 23 2015, 3:07 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

• Mattflaschen-WMF renamed this task from Investigate Parsoid's scrubWikitext to Consider using Parsoid's scrubWikitext.Apr 23 2015, 3:07 AM

• Mattflaschen-WMF set Security to None.

• Mattflaschen-WMF assigned this task to Catrope.Apr 23 2015, 5:51 PM

• Mattflaschen-WMF triaged this task as High priority.

Change 206186 had a related patch set uploaded (by Catrope):
Pass scrubWikitext=true to Parsoid

https://gerrit.wikimedia.org/r/206186

gerritbot added a project: Patch-For-Review.Apr 23 2015, 8:52 PM

Catrope added a project: Collaboration-Team-Sprint-A-2015-05-06.Apr 23 2015, 8:54 PM

Catrope moved this task from Sprint A - ends May 6 to Needs Review on the Collaboration-Team-Sprint-A-2015-05-06 board.Apr 23 2015, 8:58 PM

How can this be tested? What is it supposed to do?

SBisson moved this task from Needs Review to Code Review Started on the Collaboration-Team-Sprint-A-2015-05-06 board.Apr 24 2015, 1:51 PM

According to description, "it is opt-in and doesn't do anything", so can't really test much yet. But setting the param seems fine.

matthiasmullie moved this task from Code Review Started to QA Review on the Collaboration-Team-Sprint-A-2015-05-06 board.Apr 24 2015, 2:02 PM

Change 206186 merged by jenkins-bot:
Pass scrubWikitext=true to Parsoid

https://gerrit.wikimedia.org/r/206186

Catrope mentioned this in rEFLW61619e985654: Pass scrubWikitext=true to Parsoid.Apr 24 2015, 2:03 PM

Diffusion mentioned this in rMEXTd97a4b6175e0: Updated mediawiki/extensions Project: mediawiki/extensions/Flow….Apr 24 2015, 2:04 PM

We have one normalization already deployed:

Strip empty headings : <h1></h1> or <h2></h2>, etc. will be removed. Otherwise, they will serialize to =<nowiki/>=, ==<nowiki/>==, etc.

• Mattflaschen-WMF moved this task from QA Review to Done on the Collaboration-Team-Sprint-A-2015-05-06 board.Apr 24 2015, 5:36 PM

Catrope moved this task from Done to QA Review on the Collaboration-Team-Sprint-A-2015-05-06 board.Apr 24 2015, 5:37 PM

Checked in betalabs( with headings).

• Mattflaschen-WMF moved this task from QA Review to Product Review on the Collaboration-Team-Sprint-A-2015-05-06 board.Apr 28 2015, 3:00 AM

• DannyH closed this task as Resolved.Apr 29 2015, 6:12 PM

• DannyH moved this task from Product Review to Done on the Collaboration-Team-Sprint-A-2015-05-06 board.

• DannyH subscribed.

• DannyH moved this task from Untriaged to Resolved on the Collaboration-Team-Triage board.May 1 2015, 5:23 PM