Page MenuHomePhabricator
Create Task
Maniphest T175844

Provide oozie job running ClickStream spark job regularly
Closed, ResolvedPublic5 Estimated Story Points
Actions

Description

Once a month for every big wiki should do I think.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Add clickstream rsync for external visibilityoperations/puppetproduction+15 -0
Add clickstream oozie jobanalytics/refinerymaster+926 -2
Correct bug in ClickstreamBuilderanalytics/refinery/sourcemaster+2 -2
Customize query in gerrit

Related Objects

Event Timeline

JAllemandou created this task.Sep 13 2017, 5:27 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 13 2017, 5:27 PM
JAllemandou mentioned this in T158972: Spark job to produce clickstream dataset .Sep 13 2017, 5:27 PM
• Nuria subscribed.Sep 13 2017, 6:17 PM

Let's make sure we update documentations and anounce release of new data once this task is done. Probably blogpost worthy

• Nuria assigned this task to JAllemandou.Oct 25 2017, 3:06 PM
• Nuria moved this task from Next Up to In Progress on the Analytics-Kanban board.
JAllemandou moved this task from In Progress to Paused on the Analytics-Kanban board.Oct 31 2017, 3:05 PM
gerritbot subscribed.Nov 9 2017, 11:41 AM

Change 390226 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Add clickstream oozie job

https://gerrit.wikimedia.org/r/390226

gerritbot added a project: Patch-For-Review.Nov 9 2017, 11:41 AM

Change 390227 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery/source@master] Correct bug in ClickstreamBuilder

https://gerrit.wikimedia.org/r/390227

gerritbot added a comment.Nov 9 2017, 2:03 PM

Change 390227 merged by Ottomata:
[analytics/refinery/source@master] Correct bug in ClickstreamBuilder

https://gerrit.wikimedia.org/r/390227

Ottomata set the point value for this task to 5.Nov 20 2017, 4:59 PM
Ottomata moved this task from Paused to In Code Review on the Analytics-Kanban board.
gerritbot added a comment.Dec 7 2017, 5:50 PM

Change 390226 merged by Joal:
[analytics/refinery@master] Add clickstream oozie job

https://gerrit.wikimedia.org/r/390226

JAllemandou moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Dec 7 2017, 9:09 PM
gerritbot added a comment.Dec 8 2017, 11:47 AM

Change 396324 had a related patch set uploaded (by Joal; owner: Joal):
[operations/puppet@production] Add clickstream rsync for external visibility

https://gerrit.wikimedia.org/r/396324

gerritbot added a comment.Dec 15 2017, 4:16 PM

Change 396324 merged by Elukey:
[operations/puppet@production] Add clickstream rsync for external visibility

https://gerrit.wikimedia.org/r/396324

JAllemandou moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Dec 18 2017, 2:24 PM
• Nuria closed this task as Resolved.Dec 19 2017, 11:05 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits