[WDQS Streaming Updater] Organise module structure
Closed, ResolvedPublic5 Estimated Story Points
Actions

Description

As a developer I want to have a structure of the rdf project to match the functionalities so that I can easier move around it and explain it.

Right now, every functionality related to updating is either in tools/common (old updater + shared code) and in streaming-updater + rdf-spark-tools. We should reorganise the structure with best practices in mind.

AC:

shared code is put in separate module and logically named.
tools is no longer a catch-all module.

Details

	Project	Branch	Lines +/-	Subject
	wikidata/query/rdf	master	+444 -68	Module reorganization for streaming updater

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T244590 [Epic] Rework the WDQS updater as an event driven application
Open	Zbyszko	T261119 Architecture review of Flink based WDQS Streaming Updater
Resolved	Zbyszko	T251096 [WDQS Streaming Updater] Organise module structure

Event Timeline

Zbyszko created this task.Apr 27 2020, 8:29 AM

Restricted Application added a project: Wikidata. · View Herald TranscriptApr 27 2020, 8:29 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Zbyszko added a parent task: T244590: [Epic] Rework the WDQS updater as an event driven application.Apr 27 2020, 8:29 AM

Gehel moved this task from All WDQS-related tasks to Scaling on the Wikidata-Query-Service board.Apr 29 2020, 12:40 PM

Gehel moved this task from Scaling to Current work on the Wikidata-Query-Service board.Aug 10 2020, 1:57 PM

Gehel added a project: Discovery-Search (Current work).

Zbyszko updated the task description. (Show Details)Aug 10 2020, 3:51 PM

CBogen set the point value for this task to 5.Aug 10 2020, 3:53 PM

CBogen moved this task from Incoming to Ready for Development on the Discovery-Search (Current work) board.

Gehel added a parent task: T261119: Architecture review of Flink based WDQS Streaming Updater.Aug 24 2020, 12:40 PM

Zbyszko claimed this task.Aug 28 2020, 10:37 AM

Zbyszko moved this task from Ready for Development to In Progress on the Discovery-Search (Current work) board.

Change 623611 had a related patch set uploaded (by ZPapierski; owner: ZPapierski):
[wikidata/query/rdf@master] Module reorganization for streaming updater

https://gerrit.wikimedia.org/r/623611

gerritbot added a project: Patch-For-Review.Sep 1 2020, 3:23 PM

Zbyszko moved this task from In Progress to Needs review on the Discovery-Search (Current work) board.Sep 3 2020, 9:46 AM

Change 623611 merged by jenkins-bot:
[wikidata/query/rdf@master] Module reorganization for streaming updater

https://gerrit.wikimedia.org/r/623611

Maintenance_bot removed a project: Patch-For-Review.Sep 9 2020, 1:10 PM

Zbyszko moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Sep 9 2020, 1:50 PM

Zbyszko moved this task from Needs Reporting to To Be Deployed on the Discovery-Search (Current work) board.

Zbyszko moved this task from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.Sep 21 2020, 5:33 PM

Gehel closed this task as Resolved.Sep 28 2020, 2:41 PM