Maniphest T341728

WikiLambda metrics: Create wikilambda_zobject_function_join table in Hive
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	DMartin-WMF
	Jul 12 2023, 8:35 PM

Tags

Referenced Files

None

Subscribers

Description

Description

Provide an hql script (in the analytics/refinery repo) that creates the wikilambda_zobject_function_join table in Hive. The table will receive sqoop output periodically, extracted from the WikiLambda table wikilambda_zobject_function_join.

An example script may be seen in this patch.

The WikiLambda table is declared here.

Related to T341724.

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Front-end_Task/Bug_Completion_Checklist

Details

	Subject	Repo	Branch	Lines +/-
	Create wikilambda_zobject_labels & wikilambda_zobject_function_join tables in Hive	analytics/refinery	master	+62 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open	BUG REPORT	None	T344206 Special:MathStatus exception error on Wikifunctions
		Resolved		Jdforrester-WMF	T342865 Post-creation work for wikifunctionswiki
		Resolved		Jdforrester-WMF	T323399 Add Wikifunctions as a sibling project to the Portals once it launches
		Resolved		cmassaro	T342820 Migrate wikifunctions.org from locked-down to limited mode, letting users edit wikitext pages and some
		Resolved		DMartin-WMF	T341748 Wikifunctions metrics: Track inventory of functions, implementations, tests
		Resolved		DMartin-WMF	T341733 WikiLambda metrics: Track how many tests & implementations exist
		Open		None	T341734 WikiLambda metrics: Track how many tests & implementations are connected to their functions
		Resolved		DMartin-WMF	T341728 WikiLambda metrics: Create wikilambda_zobject_function_join table in Hive

Event Timeline

DMartin-WMF created this task.Jul 12 2023, 8:35 PM

DMartin-WMF updated the task description. (Show Details)Jul 12 2023, 8:39 PM

DMartin-WMF added a parent task: T341733: WikiLambda metrics: Track how many tests & implementations exist.Jul 12 2023, 9:04 PM

DMartin-WMF added a parent task: T341730: WikiLambda: Use wikilambda_zobject_function_join to record whether implementations/tests are connected.Jul 12 2023, 9:08 PM

DMartin-WMF removed a parent task: T341730: WikiLambda: Use wikilambda_zobject_function_join to record whether implementations/tests are connected.Jul 12 2023, 9:11 PM

DMartin-WMF added a parent task: T341734: WikiLambda metrics: Track how many tests & implementations are connected to their functions.

DMartin-WMF mentioned this in T341730: WikiLambda: Use wikilambda_zobject_function_join to record whether implementations/tests are connected.Jul 12 2023, 10:31 PM

DMartin-WMF added a parent task: T341748: Wikifunctions metrics: Track inventory of functions, implementations, tests.Jul 12 2023, 11:15 PM

Jdforrester-WMF moved this task from To triage to Phase λ – Launch on the Abstract Wikipedia team board.Jul 13 2023, 4:49 PM

Jdforrester-WMF edited projects, added Abstract Wikipedia team (Phase λ – Launch); removed Abstract Wikipedia team.

Jdforrester-WMF moved this task from Incoming to Engineering tasks on the Abstract Wikipedia team (Phase λ – Launch) board.

Change 937997 had a related patch set uploaded (by David Martin; author: David Martin):

[analytics/refinery@master] Create wikilambda_zobject_labels & wikilambda_zobject_function_join tables in Hive

https://gerrit.wikimedia.org/r/937997

gerritbot added a project: Patch-For-Review.Jul 14 2023, 5:03 PM

DMartin-WMF added a project: Data Products.Jul 14 2023, 6:12 PM

Jdforrester-WMF changed the task status from Open to In Progress.Jul 17 2023, 7:02 PM

Jdforrester-WMF moved this task from Engineering tasks to In progress on the Abstract Wikipedia team (Phase λ – Launch) board.

DMartin-WMF claimed this task.Jul 17 2023, 8:54 PM

Change 937997 merged by Milimetric:

[analytics/refinery@master] Create wikilambda_zobject_labels & wikilambda_zobject_function_join tables in Hive

https://gerrit.wikimedia.org/r/937997

Maintenance_bot removed a project: Patch-For-Review.Jul 18 2023, 6:11 PM

Jdforrester-WMF moved this task from In progress to QA needed on the Abstract Wikipedia team (Phase λ – Launch) board.Jul 19 2023, 12:01 AM

DVrandecic closed this task as Resolved.Jul 19 2023, 4:01 AM

DMartin-WMF mentioned this in T363436: WikiLambda metrics: Create wikilambda_zobject_join table in Hive.Thu, Apr 25, 5:22 AM