Maniphest T429250

data-reload: implement gen_rev_map task
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	gmodena
	Jun 15 2026, 7:51 PM

Project Tags

Referenced Files

None

Subscribers

Description

We need a gen_rev_map task that implements

org.wikidata.query.rdf.spark.transform.structureddata.dumps.EntityRevisionMapGenerator

parametrized to read / write in the wikidata namespace.

References

https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/blob/main/search/dags/import_ttl.py?ref_type=heads#L267

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		gmodena	T431253 [DE2.4.2] WDQS v2 Scaling
		Stalled		gmodena	T422179 Set up regular bulk data ingestion and indexing pipeline
		Resolved		gmodena	T428237 data-reload: spark processing jobs need to be orchestrated in the wikidata dag.
		Resolved		gmodena	T429250 data-reload: implement gen_rev_map task

Event Timeline

gmodena created this task.Jun 15 2026, 7:51 PM

gmodena mentioned this in T428237: data-reload: spark processing jobs need to be orchestrated in the wikidata dag..Jun 16 2026, 12:36 PM

gmodena claimed this task.Jun 17 2026, 11:24 AM

gmodena edited projects, added: Wikidata Platform Team (Sprint 06 (2026/06/02)); removed: Wikidata Platform Team.

gmodena set the point value for this task to 1.

gmodena moved this task from Backlog to In Engineering on the Wikidata Platform Team (Sprint 06 (2026/06/02)) board.Jun 17 2026, 11:26 AM

gmodena moved this task from In Engineering to In Code Review on the Wikidata Platform Team (Sprint 06 (2026/06/02)) board.Jun 23 2026, 12:35 PM

BTracy-WMF moved this task from Sprint 06 (2026/06/02) to Sprint 07 (2026/07/07 on the Wikidata Platform Team board.Jul 7 2026, 3:15 PM

BTracy-WMF edited projects, added: Wikidata Platform Team (Sprint 07 (2026/07/07); removed: Wikidata Platform Team (Sprint 06 (2026/06/02)).

gmodena moved this task from Backlog to In Code Review on the Wikidata Platform Team (Sprint 07 (2026/07/07) board.Jul 7 2026, 3:26 PM

trueg moved this task from In Code Review to Needs Sign-off on the Wikidata Platform Team (Sprint 07 (2026/07/07) board.Jul 29 2026, 3:28 PM

BTracy-WMF closed this task as Resolved.Aug 3 2026, 8:23 PM