Maniphest T194957

Export function indicates wrong length (due to HTML entities converted into their ASCII representations)
Closed, InvalidPublic
Actions

Assigned To

None

Authored By

	Mijobe
	May 18 2018, 2:48 PM

Description

Special:Export indicates in the exported XML the wrong length.
To me it seems, that HTML entities cause this problem. Eg the export from the german wikipedia of article "Vergleich (Zahlen)" indicates in the text element: <text xml:space="preserve" bytes="23353">
Including the HTML entities the exported text is 25659 bytes long, having converted all HTML entities into their ASCII representations the article text becomes 23253 bytes long.
I would prefer to see the length within XML here, as it would make it easier to retrieve the content.

Event Timeline

Mijobe created this task.May 18 2018, 2:48 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 18 2018, 2:48 PM

Framawiki added a project: MediaWiki-Core-Snapshots.May 18 2018, 3:08 PM

Framawiki subscribed.

Aklapper renamed this task from Export function indicates wrong length to Export function indicates wrong length (due to HTML entities converted into their ASCII representations).May 19 2018, 9:14 AM

• Vvjjkkii renamed this task from Export function indicates wrong length (due to HTML entities converted into their ASCII representations) to urcaaaaaaa.Jul 1 2018, 1:09 AM

• Vvjjkkii triaged this task as High priority.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii removed a subscriber: Aklapper.

CommunityTechBot renamed this task from urcaaaaaaa to Export function indicates wrong length (due to HTML entities converted into their ASCII representations).Jul 2 2018, 4:01 PM

CommunityTechBot raised the priority of this task from High to Needs Triage.

CommunityTechBot updated the task description. (Show Details)

CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.

CommunityTechBot added a subscriber: Aklapper.

ArielGlenn moved this task from Backlog to Snapshot export on the MediaWiki-Core-Snapshots board.Oct 29 2018, 10:01 AM

The export is done in UTF-8 and with unix-newlines (only \n, not \r\n like under windows)

The bytes indicates the real bytes, not the characters in the document. german umlauts takes 2 bytes, for example.

From a quick check the current bytes of the page and the export matches (after the decode of entities, which is normal processing in xml)

Export function indicates wrong length (due to HTML entities converted into their ASCII representations)Closed, InvalidPublicActions

Description

Event Timeline

Export function indicates wrong length (due to HTML entities converted into their ASCII representations)
Closed, InvalidPublic
Actions