Maniphest T276978

[SPIKE] 📊Make analysis notebooks output generally available in Hadoop
Open, Needs TriagePublic5 Estimated Story Points
Actions

Assigned To

None

Authored By

	gmodena
	Mar 9 2021, 6:52 PM

Tags

Referenced Files

None

Subscribers

Description

Related to https://phabricator.wikimedia.org/T275165

Goal

Find a way to make this analysis more reusable for future services

Acceptance Criteria

We should automate the generation of dataset metrics & analysis, and programmatically expose them to researchers.
Research a possibility for tools and approaches for generating a metrics template ex: popmon

Related Objects

Mentioned In: T292747: Define and Create Logging Routines - Airflow UI
Mentioned Here: T275165: 📊 [Observability] Provide ImageMatchingAlgo Dataset Metrics

Event Timeline

gmodena created this task.Mar 9 2021, 6:52 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 9 2021, 6:52 PM

• sdkim added a project: Image-Suggestion-API.Mar 12 2021, 5:20 PM

Reevaluate estimation in a week.

• Clarakosi moved this task from Ready to In progress on the Platform Team Workboards (Image Suggestion API) board.Apr 21 2021, 8:06 PM

Analysis can be found here: https://github.com/clarakosi/ImageMatching/tree/metrics-templae/dataset_metrics/dataset_template#tools-and-approaches-for-generating-dataset-metrics

gmodena mentioned this in T292747: Define and Create Logging Routines - Airflow UI.Oct 26 2021, 6:46 PM

Removing inactive task assignee

CBogen moved this task from To Do to Data Pipeline on the Image-Suggestions board.Jul 7 2022, 6:42 PM