Page MenuHomePhabricator
Create Task
Maniphest T363435

WikiLambda metrics: Create puppet scripting for wikilambda_zobject_join
Closed, ResolvedPublic
Actions

Description

Description

In the operations/puppet repository:

  • Create new sh.erb file
  • Create new entry in sqoop_mediawiki.pp
  • Deploy and verify behavior

to run the sqoop queries from T363434.

See T342199 for an example of previous similar work.

Completion checklist

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Add wikilambda_zobject_join to puppet script for sqooping Wikifunctions tablesoperations/puppetproduction+1 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

DMartin-WMF created this task.Apr 25 2024, 5:13 AM
DMartin-WMF added a parent task: T363439: [24Q4] WikiLambda Metrics: Create DB table wikilambda_zobject_join & make it available in Analytics Data Lake.Apr 25 2024, 5:37 AM
DMartin-WMF edited projects, added: Abstract Wikipedia team (24Q4 (Apr–Jun)); removed: Abstract Wikipedia team.Apr 25 2024, 3:56 PM
DMartin-WMF triaged this task as Medium priority.Apr 25 2024, 3:59 PM
DMartin-WMF moved this task from Incoming to Ready, Features on the Abstract Wikipedia team (24Q4 (Apr–Jun)) board.
ecarg subscribed.EditedJun 6 2024, 6:25 PM

Before I forget: this also involves adding the cron job

gerritbot added a comment.Jun 12 2024, 2:29 AM

Change #1041817 had a related patch set uploaded (by David Martin; author: David Martin):

[operations/puppet@production] Add wikilambda_zobject_join to puppet script for sqooping Wikifunctions tables

https://gerrit.wikimedia.org/r/1041817

gerritbot added a project: Patch-For-Review.Jun 12 2024, 2:29 AM
Jdforrester-WMF changed the task status from Open to In Progress.Jun 12 2024, 4:42 PM
Jdforrester-WMF moved this task from Ready, Features to In Progress on the Abstract Wikipedia team (24Q4 (Apr–Jun)) board.
Jdforrester-WMF assigned this task to DMartin-WMF.Jun 14 2024, 3:09 PM
Jdforrester-WMF moved this task from In Progress to Ready to deploy on the Abstract Wikipedia team (24Q4 (Apr–Jun)) board.Jun 20 2024, 6:55 PM
DMartin-WMF added a parent task: T368103: Data QA of wikilambda_zobject_join table.Jun 20 2024, 7:44 PM
DMartin-WMF removed a parent task: T363439: [24Q4] WikiLambda Metrics: Create DB table wikilambda_zobject_join & make it available in Analytics Data Lake.Jun 20 2024, 7:47 PM
DMartin-WMF added a subtask: T367847: WikiLambda: On production, create wikilambda_zobject_join table and initialize its contents.Jul 2 2024, 4:58 AM
Jdforrester-WMF closed subtask T367847: WikiLambda: On production, create wikilambda_zobject_join table and initialize its contents as Resolved.Jul 2 2024, 5:37 PM
gerritbot added a comment.Jul 9 2024, 4:23 PM

Change #1041817 merged by Btullis:

[operations/puppet@production] Add wikilambda_zobject_join to puppet script for sqooping Wikifunctions tables

https://gerrit.wikimedia.org/r/1041817

Maintenance_bot removed a project: Patch-For-Review.Jul 9 2024, 4:31 PM
Jdforrester-WMF closed this task as Resolved.Jul 10 2024, 7:14 AM
Jdforrester-WMF moved this task from Ready to deploy to Needs Sign-off on the Abstract Wikipedia team (24Q4 (Apr–Jun)) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits