Add a query to sqoop.py (analytics/refinery repo) for periodic extraction of data from the table wikilambda_zobject_join (or whatever table name results from the work on T357552), and its transmission to the data lake. See T341724 for previous similar work.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Add wikilambda_zobject_join query to sqoop | analytics/refinery | master | +25 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T356027 WikiLambda metrics: 2023/24 suggested new metrics | |||
| Open | None | T355637 WikiLambda metrics: collect type usage for run-function requests | |||
| Open | DMartin-WMF | T355638 WikiLambda metrics: track types usage for inputs/outputs of functions | |||
| Open | None | T355923 WikiLambda metrics: Track inventory & uses of "type support" functions | |||
| In Progress | DMartin-WMF | T363439 [24Q4] WikiLambda Metrics: Create DB table wikilambda_zobject_join & make it available in Analytics Data Lake | |||
| Open | None | T368103 Data QA of wikilambda_zobject_join table | |||
| In Progress | DMartin-WMF | T363434 WikiLambda metrics: Add wikilambda_zobject_join query to sqoop |
Change #1041815 had a related patch set uploaded (by David Martin; author: David Martin):
[analytics/refinery@master] Add wikilambda_zobject_join query to sqoop