Port Parsoid tokenizer to PHP
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	tstarling
	Mar 26 2019, 10:56 PM

Description

This task tracks ongoing work to port the tokenizer component of Parsoid to PHP. The general plan is:

Fork PEG.js, rebranding as WikiPEG (complete).
Implement rule parameters in WikiPEG, in order to simplify the grammar and improve performance (implementation complete, but should have more testing).
Add a PHP generator backend to WikiPEG
Port the action code embedded within the Parsoid grammar from JS to PHP.
Port functions called by the action code to PHP. Only a mock implementation is needed for this subproject.
Analyse performance of the PHP code and do any necessary optimisation work.

	Subject	Repo	Branch	Lines +/-
	Port tokenizer to PHP	mediawiki/services/parsoid	master	+19 K -2 K

Status	Assigned	Task
Resolved	tstarling	T219337 Port Parsoid tokenizer to PHP
Resolved	tstarling	T219339 PHP generator backend for WikiPEG
Resolved	tstarling	T219341 Cross-language test suite for WikiPEG

tstarling triaged this task as Medium priority.Mar 26 2019, 11:02 PM

Change 497448 had a related patch set uploaded (by Tim Starling; owner: Tim Starling):
[mediawiki/services/parsoid@master] Port tokenizer to PHP

Change 497448 merged by jenkins-bot:
[mediawiki/services/parsoid@master] Port tokenizer to PHP

Analyse performance of the PHP code and do any necessary optimisation work.

I am going to create a separate task for it.

Mentioned in SAL (#wikimedia-operations) [2019-04-03T20:29:56Z] <arlolra> Updated Parsoid to 0b3bb10 (T219337)