Page MenuHomePhabricator

AQS 2.0: aqsassist - Extract some repeated common code from services to this module
Open, LowPublic13 Estimated Story Points

Description

Goal

Extract to aqsassist some repeated and common code that is present in all the services and refactor them to avoid code duplication as we already did with the functions we created to validate the parameters in the handlers.

About the Druid common code refactoring we will take the following into consideration:

Tasks
Notes

An existing branch (https://gitlab.wikimedia.org/repos/generated-data-platform/aqs/aqsassist/-/tree/T343907?ref_type=heads) in aqsassist contains a first approach for the pending work of this task (All services common code). Just keep in mind that some work is already done there and we should keep working from that existing branch.

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Sfaci moved this task from Ready for Code Review to In Process on the Data Products (Sprint 00) board.

MR about common Druid code was already merged. Working on common error messages and problem/logger functions.

Change 956779 had a related patch set uploaded (by Santiago Faci; author: Santiago Faci):

[generated-data-platform/aqs/editor-analytics@main] Added druid-schemas.yaml as a local config file

https://gerrit.wikimedia.org/r/956779

This live branch is ready to be reviewed as a preliminary approach for common messages and problem and logger functions

Change 956779 merged by Santiago Faci:

[generated-data-platform/aqs/editor-analytics@main] Added druid-schemas.yaml as a local config file

https://gerrit.wikimedia.org/r/956779

Sfaci moved this task from Ready for Testing to In Process on the Data Products (Sprint 01) board.
Sfaci added a subscriber: EChukwukere-WMF.

I claimed the task to start working on refactoring edit-analytics to use the common Druid-code already included in the aqsassist module

Change 961121 had a related patch set uploaded (by Santiago Faci; author: Santiago Faci):

[generated-data-platform/aqs/edit-analytics@main] Refactored to use the common Druid code

https://gerrit.wikimedia.org/r/961121

Sfaci updated the task description. (Show Details)
Sfaci updated the task description. (Show Details)
Sfaci moved this task from In Process to Ready for Code Review on the Data Products (Sprint 01) board.

Change 961121 merged by jenkins-bot:

[generated-data-platform/aqs/edit-analytics@main] Refactored to use the common Druid code

https://gerrit.wikimedia.org/r/961121

Test status: QA PASS

No functional changes here as all endpoints work as expected.

Sfaci removed EChukwukere-WMF as the assignee of this task.
Sfaci added a project: AQS2.0.
Sfaci removed a project: Data Products (Sprint 02).
VirginiaPoundstone lowered the priority of this task from Medium to Low.Jan 22 2024, 9:49 PM
JEbe-WMF subscribed.

Change 994880 had a related patch set uploaded (by Jennifer Ebe; author: Jennifer Ebe):

[generated-data-platform/aqs/geo-analytics@main] AQS 2.0:Extract some repeated common code from services to this module

https://gerrit.wikimedia.org/r/994880

Change 998774 had a related patch set uploaded (by Jennifer Ebe; author: Jennifer Ebe):

[generated-data-platform/aqs/page-analytics@main] Refactor Page Analytics with AQS-Assist

https://gerrit.wikimedia.org/r/998774

Sfaci updated the task description. (Show Details)
Sfaci set the point value for this task to 13.Feb 22 2024, 11:51 AM

Change 1005966 had a related patch set uploaded (by Jennifer Ebe; author: Jennifer Ebe):

[generated-data-platform/aqs/media-analytics@main] Refactor Media Analytics with AQS Assist

https://gerrit.wikimedia.org/r/1005966

Change 1007410 had a related patch set uploaded (by Jennifer Ebe; author: Jennifer Ebe):

[generated-data-platform/aqs/device-analytics@main] Refactor Device Analytics with AQS-Assist

https://gerrit.wikimedia.org/r/1007410

Updates
Refactoring 6 services using AQS

  1. Geo-Analytics - Few comments
  2. Page-Analytics - Few comments
  3. Media-Analytics - Few comments
  4. Device-Analytics- Ready to merge
  5. Edit-Analytics - Working on it
  6. Editor-Analytics - Not started

Change #1007410 merged by Sg912:

[generated-data-platform/aqs/device-analytics@main] Refactor Device Analytics with AQS-Assist

https://gerrit.wikimedia.org/r/1007410

Change #998774 merged by jenkins-bot:

[generated-data-platform/aqs/page-analytics@main] Refactor Page Analytics with AQS-Assist

https://gerrit.wikimedia.org/r/998774

Change #1005966 merged by jenkins-bot:

[generated-data-platform/aqs/media-analytics@main] Refactor Media Analytics with AQS Assist

https://gerrit.wikimedia.org/r/1005966

Change #994880 merged by jenkins-bot:

[generated-data-platform/aqs/geo-analytics@main] AQS 2.0:Extract some repeated common code from services to this module

https://gerrit.wikimedia.org/r/994880