Steps to replicate the issue (include links if applicable):
- Navigate to this URL with the Minerva TOC experiment enabled and legacy parser: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:treatment&useparsoid=0
- In a new tab navigate to this URL with the Minerva TOC experiment enabled and legacy parser: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:control&useparsoid=0
What happens?:
Notice that the infobox appears before the lead paragraph in treatment BUT not in control. This means this is not a proper A/B test.
Notice that images are NOT lazy loaded and all load on page load
What should have happened instead?:
The lead paragraph appears before the infobox. This is based on MoveLeadParagraphTransform logic in MobileFrontend.
Software version (on Special:Version page; skip for WMF-hosted wikis like Wikipedia):
Other information (browser name/version, screenshots, etc.):
Decision path for fix
Out come of spike on T416503 was that we could make a transform hack that seemed to work, but Jon and Brooke agreed the risk of breaking non-experiment code was greater than we were comfortable with and we plan to force the control group to use parsoid for consistency between the two parts of the experiment, without any effect on non-experiment renderings.
QA notes
- (once live on enwiki, or make a copy on beta)
- confirming the lead paragraph works when not overridden:
- treatment with no override should show paragraph above the infobox: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:treatment&useskin=minerva
- control with no override should show paragraph above the infobox: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:control&useskin=minerva
- confirming that the URL override still takes priority:
- treatment with useparsoid=0 should show *paragraph above the infobox* because user opted into the bug :D : https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:treatment&useskin=minerva&useparsoid=0
- control with useparsoid=0 should show infobox above the paragraph: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:control&useskin=minerva&useparsoid=0
- treatment with useparsoid=1 should show paragraph above the infobox: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:treatment&useskin=minerva&useparsoid=1
- control with useparsoid=1 should show paragraph above the inofbox: https://en.wikipedia.org/wiki/Alfalfa?mpo=minerva-toc-button:control&useskin=minerva&useparsoid=1

